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I.  INTRODUCTION 


A.  GENERAL 

Defense  decision  makers  face  a  difficult  planning  and 
management  task:  assuring  that  their  peacetime  decisions 
result  in  maximum  effectiveness  of  their  combat  units  in  a 
wartime  environment.  It  is  apparent  that  the  defense  deci¬ 
sions  made  today  have  great  impact  on  a  nation's  security  in 
the  future . 

Since  the  end  of  World  War  II,  the  primary  emphasis  of 
logistics  modelling  has  been  to  minimize  cost  under  peace¬ 
time  conditions.  This  is  a  consequence  of  a  long  period  of 
relatively  universal  peacetime  conditions;  the  enormous  cost 
of  modern  sophisticated  weapon  systems;  the  long  lead  times, 
from  the  procurement  to  actual  deployment,  of  these  systems; 
and  the  general  reduction  in  defense  budgets  over  the  years 
(with  the  exception  of  the  most  recent  historical  period) . 

As  a  result,  the  logistics  component  of  military  resource 
requirements  is  becoming  increasingly  costly,  with  control 
loosely  related  to  operational  performance.  Furthermore,  it 
is  highly  vulnerable  to  military  budget  cutting  (Drezner  and 
Hillestad,  1982). 

Defense  decisions  must  be  objectively  oriented.  Unin¬ 
structed  and  unaided  intuition  alone  is  insufficient. 

Models  must  be  a  part  of  the  decision-making  process. 


Drezner  and  Hillestad  (1982)  point  out  that,  as  a  result  of 
economic  emphasis,  and  lack  of  distinct  relationships  to  the 
operational  performance,  models  are  constructed  around 
peacetime  efficiency,  by  considering  systems  and  policies 
that  are  based  on  least-cost  peacetime  alternatives.  Rich, 
Stanley  and  Anderson  (1984)  point  out  that  logistics 
planning  must  now  more  directly  and  explicitly  consider 
wartime  threats  and  activities.  In  their  words: 

The  weapon  system  development  community  should  develop 
analytical  approaches  and  tools  to  evaluate  trade-offs  in 
operating  concepts  founded  on  alternative  basing  and  sup¬ 
port  arrangements.  Moreover,  a  weapon  system's  support 
characteristics  should  receive  increased  emphasis  and 
clearer  articulation  in  the  formal  expression  of  system 
requirements  in  the  design  and  development  stage.  That 
emphasis  must  be  matched  by  a  more  concerted  use  of  logis¬ 
tics  capability  assessment  models  during  concept  formula¬ 
tion  and  advanced  development  and  by  earlier  testing  and 
evaluation  aimed  at  uncovering  the  correcting  weapon  sys¬ 
tem  support  characteristics  that  could  limit  the  system's 
combat  effectiveness. 

We  endorse  the  above  views,  and  believe  that  the  models 
constructed  and  analyzed  in  this  thesis  provide  a  step  in 
the  indicated  direction. 

The  main  objective  of  this  thesis  is  to  develop  analyti¬ 
cal  models  that  will  assist  in  making  decisions  regarding 
the  design  or  procurement  and  operation  of  a  defensive 
weapon  system. 

This  thesis  analyzes  an  air  defense  weapon  system,  in 
particular  an  air-interceptor  squadron,  and  constructs 
combat-logistics  models  for  its  performance.  In  general 


these  models  or  their  extensions  can  be  applied  to  other 
types  of  weapon  systems  and  warfare  scenarios. 


B.  BACKGROUND 

We  start  by  describing  the  characteristics  of  the  real 
problem  facing  the  defender,  sketching  the  main  features  we 
choose  to  model,  and  stating  the  decision  problems  we 
address  in  this  thesis. 

The  real  problem  as  faced  by  the  defender  consists  of 
the  following  components: 

(a)  Threat :  There  exists  the  possibility  that  the  enemy 
will  carry  out  a  hostile  air  attack  against  a  small 
country  (or  region)  with  a  single  defending  air  base. 

(b)  Air  Defense  System:  In  order  to  defend  the  country 
from  a  hostile  air  attack,  the  defender  needs  to  de¬ 
sign  (or  procure)  and  operate  an  air  defense  system. 
The  air  defense  system  is  to  consist  of  an  air- 
interceptor  squadron,  short -medium  range  surface-to- 
air  missiles  (SAM) ,  an  early  warning  system,  communi¬ 
cation  command  and  control  (C3)  system,  and  an 
intelligence  system. 

(c)  Early  Warning  System:  The  early  warning  system  con¬ 
sists  of  a  long-range  ground-based  radar  with  identi¬ 
fication  friendly  or  foe  (IFF)  capability.  The 
system  perhaps  uses  information  obtained  from  an  air¬ 
borne  warning  and  control  system  (AWACS)  operated  by 
friendly  forces. 

(d)  Intelligence  System:  Intelligence  information  can  be 
provided  by  monitoring  enemy  movements  and  deploy¬ 
ments,  monitoring  enemy  military  training  activities 
and  their  military  communications.  Analysis  of  the 
information  obtained  provides  expectations  about 
enemy  intentions. 

(e)  Logistics  Systems:  The  logistics  system  consists  of 
repair  shops  and  a  supply  depot.  Each  repair  shop  is 
specialized  in  repairing  a  certain  type  of  module, 
e.g.,  engine,  radar,  airframe,  etc.  Each  shop  is 
assigned  a  certain  number  of  "repairmen."  We  use  the 
term  "repairmen"  to  stand  for  repair  units;  the 
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limitations  on  the  units'  capacity  for  work  may 
actually  be  instrumentation,  tools,  or  the  availa¬ 
bility  of  spare  parts.  The  supply  depot  is  provided 
on  base. 

The  air  interceptor  squadron  is  assigned  peacetime  mis¬ 
sions,  such  as  training  and  reconnaissance.  The  equipment 
on  the  interceptor  is  susceptible  to  failure  during  such 
(essential)  operations.  Thus  some  of  the  air-craft  assigned 
to  the  squadron  may  not  be  available  at  a  given  moment. 

The  logistics  system  is  responsible  for  maintaining 
maximum  aircraft  readiness;  the  aircrew,  the  C3 ,  and  the 
early  warning  systems  assist  in  causing  maximum  destruction 
to  enemy  bombers.  Clearly,  there  is  a  need  for  models  that 
are  capable  of  answering  questions  concerning  the 
effectiveness  of  new  weapon  systems  in  combat,  and  of 
analyzing  the  tradeoffs  between  the  various  components  of 
the  weapon  system.  The  combat-logistics  models  presented 
here  contribute  to  fulfilling  this  need. 

This  research  constructs  and  analyzes  some  combat- 
logistics  models  for  the  air-interceptor  squadrons.  The 
combat-logistics  models  integrate  logistics  models  with 
combat  models. 

The  objectives  of  combat-logistics  modelling  are: 

(i)  to  determine  the  optimal  weapon  system:  given  a 

specific  threat,  what  is  the  optimal  weapon  system 
to  be  procured  in  order  to  optimize  a  certain 
measure  of  effectiveness  (MOE)  in  combat?  This 
question  is  to  be  answered  with  consideration  paid 
to  budget,  manpower  and  storage  space  limitations. 


(ii)  to  provide  an  approach  for  evaluating  the  effects  of 
changes  in  the  logistics  system  (in  non-combat 
periods)  on  the  effectiveness  of  the  weapon  system 
(in  combat  periods). 


C .  APPROACH 

The  approach  chosen  for  developing  the  combat-logistics 
model  is: 

1.  To  analyze  the  aircraft  squadron  logistics  system  and 
construct  analytical  models  to  represent  it. 

2.  To  model  and  analyze  the  effect  of  considering  differ¬ 
ent  surprise  scenarios. 

3.  To  develop  analytical  air-to-air  combat  models  that 
can  represent  the  type  of  combat  the  squadron  is  ex¬ 
pected  to  undergo  in  case  of  enemy  attack. 

4.  To  integrate  the  models  constructed  in  (1)  and  (2) 
with  the  combat  models  constructed  in  (3)  above,  and 
use  mathematical  programming  techniques  to  optimize 
the  effectiveness  of  the  squadron  subject  to  antici¬ 
pated  "real  life"  conditions  and  cost  constraints. 


D.  LITERATURE  REVIEW 

Our  interest  is  mainly  in  the  analytical  side  of  the 
general  problem  outlined,  and  we  review  some  of  the  work 
that  has  been  done  on  related  problems. 

Multi-echelon  inventory  problems  have  recently  received 
considerable  attention  by  logistics  analysts.  This  is 
because  the  multi-echelon  problem  captures  many  logistics 
factors  such  as:  the  effect  of  component  shortages  on 
weapon  system  availability,  the  stockage  levels  at  the 
supply  depot,  repair  capability,  the  existence  of  appropri¬ 
ate  and  reliable  test  equipment,  manpower,  and  transporta¬ 
tion.  Zangwill  (1966)  developed  a  deterministic  model  to 


determine  the  optimal  production  schedule  for  a  multi¬ 
product,  multi-facility  production  and  inventory  problem. 
Sherbrooke  (1968)  took  a  major  step  in  analyzing  multi¬ 
echelon  supply  systems  by  developing  the  Multi-Echelon 
Technique  for  Recoverable  Items  Control  (METRIC) ,  which  is 
an  analytical  model  of  a  base-depot  supply  system.  The 
METRIC  model  assumes  that  the  item  demand  is  a  stationary 
compound  Poisson  process  with  a  mean  value  estimated  by  a 
Bayesian  procedure.  A  failed  item  is  repaired  on  base  with 
probability  g,  or  sent  for  depot  repair  with  probability  1- 
g.  If  an  item  is  sent  for  depot  repair,  the  base  gener¬ 
ates  a  resupply  request  on  the  depot.  The  model  assumes  no 
lateral  resupply  between  bases.  The  model  minimizes  the 
expected  backorders  for  any  system  investment,  and  computes 
the  optimal  redistribution  of  stock. 

Muckstadt  (1973)  extended  the  results  of  METRIC  to 
incorporate  a  multi-indenture  (subcomponents  of  components) 
relationship.  Mod-METRIC  computes  both  base  and  depot  spare 
stock  levels  for  all  items  and  all  indenture  levels. 

A  further  extension  of  METRIC,  which  considers  non¬ 
stationary  demand  processes,  is  the  Dyna-METRIC  model,  see 
Hillestad  (1982) .  For  a  description  of  Dyna-METRIC  from  a 
logistician's  perspective,  the  reader  is  referred  to  Pyles 
(1984).  The  Dyna-METRIC  model  assesses  the  contribution  of 
the  components'  support  processes  to  wartime  aircraft 
availability  and  sortie  rate. 
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Drezner  and  Hillestad  (1982)  point  out  that  a  major 
weakness  of  work  in  the  logistics  area  for  military  applica¬ 
tions  is  the  lack  of  consideration  of  the  weapon  system 
availability  and  capability.  The  use  of  backorder  measures 
for  determining  stockage  levels  does  not  consider  the 
importance  of  the  various  components  of  the  weapon  systems. 
Backorder  measures  are  common  in  the  METRIC  family  of 
models. 

We  now  mention  several  features  of  the  maintenance 
activity  that  can  be  incorporated  into  our  logistics  models. 

One  widely  used  method  of  increasing  operational  availa¬ 
bility  is  to  cannibalize  weapon  systems,  substituting  good 
components  from  one  downed  aircraft  to  prevent  another  air¬ 
craft  from  becoming  unavailable.  However,  this  area  has 
received  little  attention  in  the  literature,  although  the 
situation  of  full  instantaneous  cannibalization  was 
considered  (see  Fisher  and  Brennan  (1986)).  A  pioneer  work 
for  modelling  cannibalization  is  by  Hirsch,  Meisner  and  Boll 
(1968) .  The  most  recent  work  in  this  area  is  by  Fisher  and 
Brennan  (1986) ,  where  several  cannibalization  policies  are 
compared  using  simulation.  Our  study  includes  consideration 
of  cannibalization  strategies. 

Logistics  models  are  evolving  toward  the  wartime  support 
aspects  of  logistics  but  more  relevant  measures  of  military 
performance  must  be  considered.  Rich  (1986)  points  out  that 
we  cannot  be  satisfied  with  such  measures  as  aircraft 


availability  and  sortie  generation  capability.  Instead,  we 
need  to  focus  on  measures  of  system  output  such  as  targets 
killed.  The  observation  has  helped  motivate  the  research 
reported  in  this  thesis. 

A  problem  that  currently  faces  defense  decision  makers 
is  the  extensive  specialization,  and  the  resulting  size,  of 
the  maintenance  force.  An  F-16  wing,  for  example,  includes 
1089  support  personnel  organized  into  23  different  special¬ 
ties;  see  Rich,  Stanley  and  Anderson  (1984) .  This  situation 
leads  to  vulnerability  of  the  forces  being  supported  and 
stresses  manpower  resources.  An  alternative  that  decision 
makers  usually  consider  is  cross  training  of  the  maintenance 
personnel  so  that  they  become  generalists,  i.e.,  capable  of 
repairing  more  than  one  type  of  system  (e.g. ,  propulsion 
system,  hydraulic  system,  fuel  system,  etc.).  This  alterna¬ 
tive  becomes  more  attractive  as  the  technology  evolves,  and 
systems  are  designed  to  be  more  modular.  Increasingly, 
repairs  at  the  base  level  consist  of  fault  detection  and 
replacement  of  the  faulty  modules.  The  faulty  modules  are 
then  sent  to  the  depot  for  actual  repair. 

Rich,  Stanley  and  Anderson  (1984)  also  point  out  that 
combat  forces  must  be  able  to  operate  in  forward  areas  with 
minimal  support  resources.  This  means  streamlining  the 
flightline  workforce  by  training  and  using  maintenance 
generalists . 
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If  the  above  alternative  is  employed,  then  one  of  the 
major  questions  that  will  face  the  decision  makers  is:  how 
to  manage  the  maintenance  force  so  that  the  air-interceptor 
squadron  readiness  is  sustained  at  the  maximum  possible 
level?  Chapter  III  of  this  thesis  addresses  this  question 
by  searching  for  an  optimal  repairmen  assignment  policy  that 
maximizes  the  expected  number  of  aircraft  ready  to  engage  in 
combat.  We  do  this  by  formulating  the  problem  as  a 
multivariate-continuous-time  Markovian  decision  process. 

Recently,  Szarkowicz  and  Knowles  (1985)  considered  the 
problem  of  determining  optimal  operating  policies  for  an 
M/M/S  queueing  system.  The  system  state  is  represented  by  a 
bivariate  vector,  the  first  component  is  the  number  of 
customers  in  the  system,  and  the  second  component  is  the 
number  of  active  servers.  They  used  a  continuous  time 
Markov  decision  process  formulation  to  obtain  an  optimal 
control  policy  for  the  number  of  active  servers;  the  cost 
structure  includes  customer  holding  and  server  operating 
costs  as  well  as  a  linear  switching  cost. 

The  problem  that  Sparkowicz  and  Knowles  analyzed  differs 
from  our  problem,  since  we  consider  more  than  one  type  of 
item  to  be  repaired,  and  we  need  to  have  an  item  of  each 
type  to  be  operational  in  order  to  have  an  operational 


aircraft. 


For  more  work  related  to  this  area,  the  reader  is 
referred  to  Howard  (1969),  Zuckerman  (1986),  Jo  (1984), 
Crabill  (1972)  and  Miller  (1968a),  (1968b)  and  (1969). 

To  consider  the  effect  of  the  logistics  system  and  the 
allocation  of  fixed  monetary  resources  to  competing  but 
interrelated  demands  (such  as,  spares,  test  equipment, 
personnel,  etc.)  on  the  combat  outcome  of  the  weapon  system, 
we  need  to  consider  the  combat  process  explicitly  in  the 
model . 

In  order  to  keep  the  model  analytically  attractive,  we 
chose  to  represent  the  logistics  system  at  a  lower  level  of 
detail  than  the  METRIC  family  of  models,  and  to  introduce 
the  combat  model  explicitly.  The  logistics  model  is  there¬ 
fore  relatively  simple.  It  presents  only  the  most  dominant 
features  of  a  combat-logistics  process  (i.e.,  the  process 
that  the  weapon  system  undergoes  in  peace  and  wartime 
environments) .  This  research  effort  may  be  regarded  as  a 
prototype  of  a  large  family  of  more  complete  combat- 
logistics  models.  Taylor  (1980)  points  out  that  a  simple 
model  may  yield  an  understanding  of  important  relations  that 
are  difficult  to  perceive  in  a  more  complex  model,  and  such 
insights  provide  valuable  guidance  for  higher-resolution 
computerized  investigations. 

Since  the  combat  model  plays  a  role  of  the  same 
importance  as  the  logistics  model,  an  entire  chapter  of  this 
thesis  is  devoted  to  the  combat  model.  In  particular,  our 


approach  is  to  provide  efficient  computational  methods  to 
obtain  "exact"  solutions  to  multivariate  Markov  models, 
supplementing  these  with  approximate,  easily  comprehended 
approximations  based  on  diffusions. 

Recently,  Taylor  (1983)  presented  a  comprehensive 
treatise  on  Lanchester-type  models  for  combat,  i.e., 
differential-equation  models  of  attrition  in  force-on-force 
combat  operations  in  which  both  deterministic  and  stochastic 
models  for  combat  are  considered.  Taylor  (1983)  states, 
"combat  is  anything  but  a  deterministic  process."  Thus,  in 
order  to  incorporate  the  random  nature  of  combat  into  the 
model,  the  combat  process  must  be  represented  by  a  stochas¬ 
tic  process.  Combat  analysts  tend  to  represent  the  combat 
process  probabilistically  by  Markov  processes;  see  for 
example,  Taylor  (1983),  Kimble  (1970),  Clark  (1969),  and 
Bhat  (1984). 

The  most  recent  work  done  in  this  area  is  by  Karmeshu 
and  Taiswal  (1986) ,  where  they  incorporate  the  effects  of 
environmental  fluctuations  by  regarding  the  parameters  of 
the  problem  as  stochastic  processes. 

Feigin,  Pinkas,  and  Shinar  (1984)  proposed  a  simple 
Markov  model  for  the  analysis  of  many-on-many  air  combat. 

The  model  is  a  four  variate-Markov  process  where  the  state 
variables  are:  the  number  of  free  blue  planes,  the  number 
of  free  red  planes,  the  number  of  pursuing  blue  planes,  and 
the  number  of  pursuing  red  planes.  Their  solution  approach 


was  to  construct  and  solve  the  forward  Chapman-Kolmogorov 
equations. 


We  choose  to  model  the  air-to-air  combat  process  by 


generalizing  the  deterministic  model  so  that  some 


probability  statements  can  be  evaluated.  This  can  be  done 


by  representing  the  combat  process  by  a  multivariate  diffu¬ 


sion  process.  We  find  that  the  diffusion-combat  models 


constructed  in  this  thesis  provide  good  approximations  to 


the  corresponding  Markovian-combat  model.  For  the 


definition,  description  and  discussion  of  diffusion 


processes  the  reader  is  referred  to  Karlin  and  Taylor 


(1981).  For  related  work  the  reader  should  refer  to  the 


papers  of  Iglehart  (1965),  McNeil  (1973),  Schach  and  McNeil 


(1973),  Gaver  and  Lehoczky  (1975),  (1977a),  (1977b), 


(1977c),  (1979),  and  Gaver  and  Jacobs  (1985). 


E.  ORGANIZATION  OF  THE  THESIS 


This  thesis  models  a  problem  that  is  complex  and  has 


many  factors  to  be  considered.  Therefore,  we  choose  to 


decompose  the  problem  into  components:  a  logistics  problem, 


and  a  combat  problem?  we  then  analyze  each  one  separately, 


build  an  analytical  model  for  each,  then  integrate  (or  link) 


the  various  models  to  evaluate  the  system  effectiveness, 


which  is,  in  combat  terms,  some  measure  of  "leakage"  or 


survivorship  of  the  attackers.  Each  chapter  analyzes  and 


develops  a  model  for  a  specific  subproblem.  Chapter  II 


models  the  general  repair  system.  Chapter  III  studies  and 
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models  the  repairman  assignment  problem,  while  Chapter  IV 
studies  and  models  the  air-to-air  combat  problem.  Chapter  V 
provides  the  approach  for  linking  the  logistics  model  to  the 
combat  model.  Figure  (1.1)  illustrates  the  general 
structure  of  the  thesis. 

In  the  first  part  of  Chapter  II,  we  build  a  model  of  a 
simple  logistics  system.  We  assume  that  each  aircraft  re¬ 
quires  a  single  module  in  order  to  be  considered  opera¬ 
tional.  The  problem  is  modelled  as  a  birth-and-death 
process,  and  also  as  a  closed  migration  process.  A  closed 
form  solution  for  the  limiting  distribution  is  presented. 
This  is  a  simplified  version  of  the  real  problem;  it  serves 
as  a  starting  point  or  feasibility  study. 

The  surprise  phenomenon  is  then  analyzed  and  classified 
as  total  or  partial  surprise.  Depending  on  what  type  of 
surprise  is  considered,  the  squadron  readiness  probability 
distribution  is  then  computed.  A  simple  example  is  provided 
to  illustrate  the  model. 

In  the  second  part  of  Chapter  II,  we  generalize  the 
above  model  to  represent  a  two-module  logistics  system; 
i.e.,  it  is  assumed  that  each  aircraft  requires  two  opera¬ 
tional  modules  (one  of  each  type)  in  order  for  it  to  be 
considered  operational.  We  find  that  a  simultaneous  failure 
mechanism  must  be  introduced  in  order  to  have  a  realistic 
representation.  A  simultaneous  failure  mechanism  means  that 
the  conditional  probability  of  an  aircraft  failure  due  to 


both  modules  failing  is  positive.  The  problem  is  formulated 
as  a  bivariate  birth-and-death  process.  To  simplify  the 
computations  the  problem  is  then  formulated  so  that  it  can 
be  presented  in  a  matrix-geometric  form.  This  is  done  by 
adopting  the  arguments  in  Gani  and  Purdue  (1984)  and  in 
Gaver,  Jacobs  and  Latouche  (1984).  For  an  explanation  of 
the  matrix-geometric  formulation  the  reader  is  referred  to 
Neuts  (1981) .  The  squadron  readiness  probability  distribu¬ 
tion  for  the  two-module  logistics  system  is  then  presented 
for  both  types  of  surprise.  This  is  followed  by  a  simple 
example  to  illustrate  the  technique. 

In  Chapter  III,  we  hypothesize  an  operational  logistics 
scenario.  The  problem  is  a  repairmen  allocation  problem, 
where  the  repairmen  are  assumed  to  be  general  technicians 
capable  of  repairing  both  types  of  modules.  The  mainte¬ 
nance  supervisor  is  interested  in  finding  the  optimal  repair 
policy  that  maximizes  the  squadron  readiness.  The  problem 
is  formulated  as  a  bivariate-continuous-time-Markov-decision 
process.  A  one-to-one  transformation  of  a  multivariate- 
Markov  process  to  a  univariate-Markov  process  is  presented. 
The  transformation  allows  us  to  use  the  existing  theory  and 
techniques  for  the  univariate-Markov  decision  process  to 
solve  a  multivariate  one.  The  problem  is  then  solved  by 
dynamic  programming  and  linear  programming  approaches.  An 
example  to  illustrate  both  approaches  is  given,  followed  by 


a  comparison  and  evaluation  of  the  results  of  both 
approaches . 


In  Chapter  IV  we  discuss  the  characteristics  of  the  air- 
to-air  combat  and  provide  the  following  air-to-air  combat 
scenarios  to  be  modelled: 

(i)  BCD  Scenario:  Both  defenders  and  enemy  bombers  are 
assumed  to  be  vulnerable,  and  defenders  spend  some 
time  searching  for  a  free  enemy  bomber.  Once  a  free 
enemy  bomber  is  detected,  it  is  then  engaged  by  a 
free  defender.  The  one-to-one  engagement  is  assumed 
to  continue  until  either  a  bomber  or  a  defender  is 
killed.  If  the  bomber  is  killed  the  defender  once 
again  searches  for  a  free  bomber;  the  process 
continues. 

(ii)  I  Scenario:  This  scenario  assumes  that  the 
defenders  are  invulnerable.  Only  one  free  defender 
can  engage  a  free  bomber,  and  the  engagement  is 
assumed  to  be  instantaneous;  i.e.,  once  a  defender 
becomes  free,  no  time  is  spent  searching  for  a  free 
bomber  if  one  is  available  (perfect  C3  system) . 

This  is  the  simplest  situation;  it  is  characterized 
by  a  one-dimensional  Markov  chain. 

Both  of  the  above  scenarios  implicitly  assume  that  the 
enemy  bombers  arrive  in  combat  simultaneously. 

In  the  second  part  of  Chapter  IV,  we  construct  and 
analyze  deterministic  models  for  the  above  two  scenarios. 
Next  we  generalize  the  deterministic  models  by  developing 
diffusion  models  to  represent  the  air-to-air  combat.  Simple 
continuous-time  discrete-state  Markov  models  are  then 
constructed  to  represent  the  combat  processes  for  the  above 
scenarios;  the  latter  models  are  referred  to  as  Markovian- 
Combat  models  (of  course  the  diffusions  are  an  approximation 
to  these,  and  are  themselves  Markovian;  the  reason  for  using 
diffusions  is  ease  of  interpretation  and  computational 
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simplicity) .  The  forward  Chapman-Kolmogorov  equations  for 
these  models  are  derived,  as  are  their  Laplace  transforms. 
Techniques  for  solving  the  Laplace  transforms  are  presented. 


In  order  to  evaluate  and  compare  the  different 
approaches,  the  Markovian  combat  process  for  the  BCD 
scenario  is  simulated.  A  large  deviations  equation  for  the 
MOE,  under  the  I  scenario,  is  derived;  for  the  large 
deviations  approach  see  Feller  (1971) ,  and  for  applications 
see  Mazumdar  and  Gaver  (1984) . 

Finally  we  present  in  Chapter  IV  some  illustrations  to 
compare  and  analyze  the  combat  models. 

In  Chapter  V  we  study  the  entire  combat-logistics 
situation  that  confronts  the  decision  maker.  We  then 
present  the  model's  basic  concept  and  assumptions.  The 
problem  is  then  formulated  as  a  non-linear-integer  mathe¬ 
matical  programming  model. 

We  first  examine  the  single-module  combat  logistics 
(1MCL)  model  which  is  a  result  of  linking  the  single-module 
logistics  model  to  a  combat  model,  subject  to  budget  and 
operational  constraints.  The  two-module  combat  logistics 
( 2MCL)  model  is  next  constructed  as  a  generalization  for 
1MCL. 

By  way  of  illustration  we  present  some  examples  for  1MCL 
and  2MCL  models  using  both  the  BCD  and  the  I  scenarios. 

Some  sensitivity  analysis  on  the  combat  and  logistics 
parameters  are  also  conducted. 
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We  close  our  discussion  in  Chapter  VI  with  a  review  of 
the  results  obtained  and  their  implications,  and  some 
concluding  remarks  and  recommendations  for  further  research. 

Two  appendices  are  included  to  describe  additional  but 
somewhat  peripheral  research  related  to  the  main  emphasis  of 
the  thesis. 

Appendix  A  contains  a  discussion  of  the  large  deviations 
technique.  A  large  deviations  equation  for  fixed,  and 
randomized,  sums  of  independent  and  identically  distributed 
random  variables  is  presented,  followed  by  applications  to 
compound  Poisson  process  and  renewal  processes.  The 
techniques  have  application  to  classical  inventory  control 
problems.  A  proposed  approach  to  minimize  the  large  devia¬ 
tions  error  is  introduced,  followed  by  an  illustration  of 
the  approach  applied  to  the  compound  Poisson  process. 

In  Appendix  B,  we  generalize  Lanchester's  linear  law  by 
developing  a  diffusion  model.  A  simple  continuous-time 
discrete-state  Markov  model  is  then  constructed  to  represent 
the  corresponding  combat  process. 


II.  OPERATIONAL  LOGISTICS  MODELS 


A.  INTRODUCTION 

This  chapter  formulates  and  analyzes  some  operational 
logistics  problems.  Logistics  is  an  area  that  gives  rise  to 
classical  operational  research  problems  which  suggests  that  a 
considerable  body  of  work  has  been  done  in  this  area.  Never¬ 
theless,  the  linkage  between  combat  models  and  logistics  is 
a  research  area  that  is  ripe  for  further  research.  Particular 
attention  in  this  thesis  has  been  directed  towards  the  repair¬ 
man  problem.  Feller  (1971)  defines  the  repairman  problem,  and 
Kelley  (1979)  provides  a  closed  product-form  solution  for  the 
single  type  module  repairman  problem.  This  chapter  formulates 
and  solves  a  multivariate  repairman  problem  with  simultaneous 

failure  and  consequent  simultaneous  demand  for  several  resources. 

Gaver  and  Lehoscky  (1976)  formulated  and  analyzed  a  2-module 
repairman  problem,  wherein  there  was  a  number,  a,  of  aircraft, 
each  requiring  both  types  of  modules,  one  of  each,  to  operate. 
When  an  aircraft  fails  it  has  conditional  probabilities  p-^ ,  P2 
and  p12  of  being  down  due  to  a  failure  of  Type  1,  Type  2,  or 
both  types  of  modules,  respectively,  where  p^  +  p2  +  p-^  =  1 • 

This  model  assumed  that  an  aircraft  will  be  in  repair  until 
the  failed  modules  were  repaired  (i.e.,  the  assumption  indi¬ 
cates  that  there  were  no  spare  modules  assigned  to  the  organi¬ 
zation)  .  The  problem  was  modelled  as  a  diffusion  process  which 


gave  a  good  approximation  to  long-run  aircraft  availability 
when  compared  with  simulation  model  results.  Their  work  tends 
to  validate  the  use  of  a  convenient  approximate  model  (diffu¬ 
sion)  for  decision  making. 

The  single-type  module  repairman  problem  is  presented  first 
in  this  chapter  followed  by  the  two-type  module  repairman  prob¬ 
lem.  After  discussing  the  objectives  of  this  chapter,  the 
models  for  the  various  types  of  problems  will  then  be  constructed 
followed  by  sample  solutions.  The  probability  distribution 
function  for  the  interceptor  squadron  readiness  will  be  calcu¬ 
lated.  Those  results  will  then  be  used  in  Chapter  V  for  the 
blending  of  the  logistics  and  combat  models. 

B.  OBJECTIVE 

The  objective  of  this  chapter  is  to  formulate  and  analyze 
the  generalized  repairman  problem  for  the  maintenance  organi¬ 
zation  of  an  interceptor  squadron.  Analysis  of  the  repairman 
problem  means  determining  the  various  factors  affecting  the 
repair  process  in  the  organization.  A  major  factor  is  the 
number  of  different  types  of  modules  requiring  different  types 
of  repair  facilities  and  different  repair  times.  This  chapter 
analyzes  the  following  repairman  problems: 
a  single  type  of  module. 

two  types  of  modules  with  independent  failure  rates. 

two  types  of  modules  with  dependent  failure  rates,  with 
the  probability  of  a  simultaneous  failure  of  both  modules 
being  negligible. 

two  types  of  modules  with  a  non- zero  simultaneous 
failure  rate. 
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C.  SCOPE 


An  air  interceptor  squadron  is  selected  to  represent  the 
logistical  situation  under  study.  The  squadron  is  considered 
to  be  assigned  a  number,  a,  of  aircraft.  The  study  concen¬ 
trates  on  finding  the  readiness  of  the  aircraft  at  the  tine 
of  attack  by  enemy  bombers.  This  readiness  depends  upon  the 
total  number  of  each  module  type  and  the  number  and  rates  of 
repair  characteristic  of  the  repairmen  in  each  shop.  In  turn, 
the  readiness  that  results  influences  combat  effectiveness. 

D.  APPROACH 

To  achieve  the  above  objective,  the  logistics  system  of  the 
squadron  during  a  "peacetime"  (noncombat)  situation  must  be 
analyzed.  The  repair  shop  experiences  demands  for  repair, 
depending  on  the  type  of  problem  under  study.  If  the  problem 
formulation  considered  assumes  that  the  whole  aircraft  is  a  modul 
then  the  shop  experiences  a  single  type  of  demand  for  repair. 

Let  the  number  of  modules  up  at  time  tbe  {X(t),  t  >_  0); 
under  Markov  conditions  the  variable  X(t)  can  be  considered  to 
be  the  state  of  the  system.  Because  of  the  random  nature  of 
the  system  state  change,  the  process  (X(t);  t  >_  0}  represents 
a  stochastic  process.  By  introducing  certain  reasonable  assump¬ 
tions  that  will  be  stated  later,  the  process  can  be  modelled  as 
a  continuous-time  Markov  process. 

However,  if  the  problem  under  study  assumes  that  an  aircraft 
requires  each  of  two  types  of  modules  to  qualify  as  a  mission 
capable  aircraft,  then  the  two-shop  maintenance  organization 


may  experience  either  simultaneous  or  independent  demands  for 
two  types  of  repair,  depending  on  the  case  under  consideration. 
Let  the  number  of  modules  of  type  i,  i  =  1,2  for  repair  at  time 
t  be  (X^(t),  t  ^  0,  i  =  1,2}.  Then  the  bivariate  vector  having 
components  X^(t)  and  X2<t)  can  be  considered  to  be  the  state 
of  the  system  at  time  t.  If  full  cannibalization  is  allowed, 
then  X-^(t)  and  X2<t)  determine  the  number  of  aircraft  operational 
As  is  true  for  the  univariate  case,  this  process  may  be  modelled 
as  a  bivariate-continuous-time  Markov  process.  More  generally, 
if  we  have  a  multi-module,  e.g.,  K-module,  setup,  the  process 
could  be  modelled  by  a  -variate-continuous-time  Markovian 
process . 

E.  SINGLE-MODULE  PROBLEM  FORMULATION 

Consider  an  aircraft  squadron  that  consists  of  a  number,  a, 
of  failure-prone  aircraft.  Each  will  be  considered  not  mission 
capable  if,  and  only  if,  a  specific  module  is  not  working.  Let 
A  denote  the  overall  Markovian  failure  rate  of  an  aircraft, 
where  failure  of  an  aircraft  means  a  failure  of  the  module  it 
currently  carries.  Suppose  that  there  are  M  modules  assigned 
to  the  organization  where  M  a ,  and  there  are  R  repairmen 
capable  of  repairing  the  modules,  and  only  one  repairman  is 
required  to  repair  a  failed  module. 

Let  X ( t )  denote  the  number  of  modules  that  are  installed 
or  available  at  time  t.  Thus  the  number  of  mission  capable 
aircraft  is  min(a,X(t)},  which  is  the  number  of  aircraft  that 
are  failure-prone,  the  others  awaiting  a  module.  Finally,  it 


is  assumed  that  repair  is  Markovian  (or  exponential),  where  u 
denotes  the  rate  at  which  an  individual  repair  is  completed. 

Figure  (2.1)  shows  a  schematic  of  the  above  system.  Karlin 
and  Taylor  (1984)  have  analyzed  the  above  problem  and  have 
shown  that  once  X(t)  is  known,  the  number  of  modules  in  any 
category  can  be  determined.  A  module  can  be  in  any  of  four 
states : 

(i)  Operating  (installed  on  aircraft) . 

(ii)  "Up"  but  not  operating,  i.e.,  a  spare. 

(iii)  Under  repair. 

(iv)  Waiting  for  repair. 

Each  of  the  modules  down  at  time  t  must  either  be  undergoing 
or  awaiting  repair.  Thus: 

(i)  The  number  of  modules  operating  is  min{a,X(t)}. 

(ii)  The  number  of  spares  is  max{0 ,X (t) -a} . 

(iii)  The  number  of  modules  in  repair  is  min{R,M-X (t ) } . 

(iv)  The  number  waiting  for  repair  is  max{0 ,M-X (t) -R} . 

The  number  of  modules  in  any  category  can  therefore  be 

determined  easily  once  X(t)  is  known. 

The  transition  probabilities  of  the  process  {X(t),  t  _>  0}, 
of  order  dt  are  given  below: 


t+dt 


Probability 


i  -*•  i+1 

-  i-1 


\i  min{R,M-i} 

A  min { a , i }  (2.1) 


The  above  assumptions  and  formulation  specify  the  stochas¬ 


tic  process  (X(t),  t  >  0)  as  a  birth-and-death  process  with 


Capacity  =  a  air¬ 
craft 


Failure  rate  =  X 


X ( t )  =  Number  of  avai 


Repair  Shop 


Capacity  =  R 


Waiting  for 
Repair 


Repair  Rate  =  y 


state  space  {i  =  0,1,2 ,... ,M} .  The  parameters  of  the  process 
are  given  by: 


A^  =  A  xn\in{a,i} 


for  i  =  0 , 1 , 2 , . . . , a-1 


for  i  =  a  ,  .  .  .  ,M 


=  y  xmin{R,M-i} 


for  i  =  0,1,2, 


U  x  (M-i)  for  i  =  M-R+l, 


,M-R 


Let  Q  be  the  infinitesimal  generator  for  the  Markov  process 
{X(t),  t  •>  0}.  Then  Q  will  be  given  by  the  matrix  on  the  next 
page.  Define  P^  (t)  to  be  the  conditional  probability  of  the 
process  being  in  state  j  given  that  it  started  in  state  i. 


Then 


P-.(t)  =  P{X(t)  =  j | X ( 0 )  =  i}.  To  simplify  the  notation 
1  J 


we  suppress  the  initial  conditions  and  write, 


Pj(t)  =  pij (t) 


The  forward  Chapman-Kolmogorov  equations  are  derived  by 
writing  the  probability  that  the  process  is  in  state  j  at 
time  d+dt  as  a  function  of  the  state  probabilities  at  time 
t.  The  probability  of  being  in  state  j  at  time  t+dt  is 
expressed  by: 


Pj  (t+dt)  =  (1-  ( A y j  )dt) Pj  (t)  +  Uj_-jdtPj_^  (t)  +  A j+1dtP^+1  (t)  +  o(dt) 


Subtracting  P  ^ (t)  from  both  sides  and  dividing  by  dt  and 
letting  dt  tend  to  zero  results  in  the  following: 


dPj (t) 
dt 


-(Aj+Uj)P.(t)  +  +  Aj+1Pj+1(t) 


since  °  -  +  0  as  dt  +  0.  With  the  initial  condition: 


Pj  (0) 


I1 

to 


if  j  =  M 


otherwise 


the  forward  Chapman-Kolmogorov  equations  are: 


dpM(t) 

dt 


'AMPM(t)  +  yM-lPM-l(t) 


dp0(t) 

dt 


-U0P0(t)  +  A1P1(t) 


dPj (t) 
dt 


‘WVt)  +  +  »j+1pj+1(t) 


1  <  j  <  M-l 


with  the  initial  condition: 

1  if  j  =  M 
0  otherwise 


F.  LIMITING  DISTRIBUTION 


All  states  of  the  Markov  process  defined  by  (2.1)  communi¬ 
cate  so  the  Markov  process  is  irreducible.  Hence  the  limiting 
distribution  exists  and  is  independent  of  the  initial  condition. 
Since  every  state  is  a  positive  recurrent  state,  the  limiting 
values  are  all  positive  and  form  a  probability  distribution. 

This  results  from  the  following  theorem  (Bhat,  1984): 


Theorem  (2.1) 

(1)  If  the  Markov  process  is  irreducible  then  the  limiting 
distribution  lim  P.(t)  =  it.  exists  and  is  independent 
of  the  initial  conditions  of  the  process.  The  limits 
{ tt j ,  j  e  s},  where  S  is  the  state  space,  are  such  that 

tt  .  =  0  for  all 


they  either  vanish  identically  (i.e. 

J 

j  c  S)  or  are  all  positive  and  form  a  probability 
distribution  (i.e.,  tt ^  >  0  for  all  j  e  S,  £ 


j  eS 


TK  =  1)  . 


(2) 


The  limiting  distribution  { tt ,  j  £  s}  of  an  irreducible 
positive  recurrent  Markov  process  is  given  by  the  unique 

— ►  ri 

solution  of  the  equation  ttQ  =  0 ,  and  l  tt  .  =  1 ,  where 

j  ^  S  ^ 

Q  is  the  infinitesimal  generator  for  the  process,  and 
— ► 

TT  (TTq,TT^,  .  .  ,)  . 


Let  tt_.  denote  the  long-run  probability  of  the  process 
being  in  state  j.  Therefore: 


=  lim  P . ( t) 


From  the  above,  as  t  -»•  «,  -jv-  P.  (t)  0,  therefore  the 

dt  j 

forward  Chapman-Kolmogorov  equations  (2.2)  become: 


"VM  +  UM-1  M-l 


_wo1To  +  Vl  =  0 


-(X.+y.Jir.  +  +  Xj+1nj+1  =  0 


Below  are  given  alternative  methods  for  calculating  n ^ . 
Approach  1 ; 

The  finite-state-continuous-time  Markov  process 
{ X  ( t )  ,  t  >_  0}  has  been  shown  to  have  a  limiting  distribution. 

From  the  set  of  equations  (2.4),  can  be  written  recur¬ 
sively  as: 


it^_i  for  i  =  1 ,  .  .  .  ,M-R-1 


TT  .  = 


(  (M-i)  m 

v  -  tt. 


aA  i-1 


(2.5) 


for  i  =  M-R, . . . ,M 


Therefore : 


JL(RM) % 

i  !  1  A  0 


for  i  = 1 , . . . , M-R-l 


i  rm‘r 


JRJ _ ^  n  f  Or  i  =  M-R  ,  .  .  .  ,  M 


iFThTn^  ai-(M-R-i; 


and  l  tt  .  =  1 
i=0  1 


Hence 


M-R-l  M 

*0  +  l  11  i  +  l  "i 

i=l  i=M-R 


1 


1 


M-R-l 

+  I 

i=l 


i !  V  A 


M 

-  I 

i=M-R 


R! 


(M-i) ! a , 


(t-) 

A 


,M-R 


i (M-R-l) 


Thus : 


M-R-l  , 

-  <l  +  I  ir< 

i=l 


RU, 


+  |j-R(aR) 


M-R-l 


M 

i  J-R^  !  'aX 


-1 


-(— )  } 


(2.6) 


Therefore,  the  limiting  distribution  can  be  calculated  by 
determining  tt^  first  using  equation  (2.6),  and  then  applying 
equation  (2.5)  to  calculate  the  limiting  probabilities 
recursively . 


;  Approach  2 : 

Another  approach  to  computing  the  tt^  's  is  to  view  the 
system  as  a  closed  migration  process.  Kelly  (1974)  shows 
that  a  closed  product  form  can  be  derived  for  the  equilibrium 
distribution . 

The  flight  line  and  the  repair  shop  can  be  considered  as 

i 

) 

,  stations  between  which  the  modules  move.  Assume  that  modules 

cannot  leave  or  enter  the  system,  and  that  the  total  number 
|  of  modules  in  the  system,  M,  is  fixed.  Then,  X(t)  is  a  cyclic 

\  queue,  where  a  module  departing  from  one  station  joins  the 

i 

other  with  probability  1. 

Using  Kelly's  results  for  a  closed  migration  process,  we 
get  the  following  expressions  for  the  limiting  distribution: 
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B 


TT 


0 


FPT 

n 

j~o 


IT  . 

1 


B 


i  M-l 

TT  x.  n  y. 
j=l  3  j=i  3 


1  <  i  <  M-l 


(2.7) 


where : 


B 


M 


M 

n 

j=i 


X  . 


B  = 


M-l 

.n  v* 

j~0  11 


M-l 

+  l 

i=l 


l  M-l 

n  x.  n  y. 
j=l  3  j-i  : 


M 

n  x. 


j=i 


-l 


Readiness : 

The  factors  affecting  the  combat  readiness  of  an  inter¬ 
ceptor  squadron  can  be  categorized  as: 

Factors  that  are  related  to  the  logistics  system. 

Factors  that  are  related  to  the  operational  system. 

Factors  that  are  related  to  the  intelligence  or  warning 

system. 

The  logistical  factors  include  the  number  of  spare  modules 
authorized  to  keep  on  base,  the  number  of  maintenance  per¬ 
sonnel  assigned  to  the  maintenance  organization,  the  skill 
and  level  of  training  of  maintenance  personnel,  together  with 
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the  repair  policy  implemented,  the  number  and  types  of  test 
and  diagnostic  equipment,  and  the  supply  of  spare  parts. 

Finally,  the  quality  of  facility  management  is  an  intangible 
influence . 

The  operational  factors  include  the  number  of  aircraft 
assigned  to  the  squadron,  the  number  and  skill  of  the  pilots, 
the  effectiveness  of  the  training  programs,  and  the  sensitivity 
of  the  early  warning  system. 

The  intelligence  factors  include: 

(a)  The  procedures  used  in  collecting  information  about 
the  enemy  movements  including  the  prediction  of 
enemy  actions  based  on  current  political  status. 

(b)  Quality  of  the  analysis  of  the  information  collected 
and  the  confidence  of  the  decision  makers  in  the 
conclusions  reached.  Information  could  indicate  the 
intention  of  the  enemy,  however  the  defender  sometimes 
fails  to  anticipate  surprise  attacks. 

The  effect  of  surprise  is  reduced  as  the  readiness  in¬ 
creases.  Surprise  attack  can  be  classified  in  different 
stages  as:  (Brodin,  1978) 

(1)  Total  surprise, 

(2)  Partial  surprise, 

(3)  No  surprise. 

In  an  attempt  to  model  the  surprise  phenomena  mathematically, 
the  following  warning  scenario  was  considered. 

1 .  Models  for  Readiness:  Stages  of  Surprise 
a.  Total  Surprise 

Under  the  Single-Module-Logistics  formulation,  if 
a  total  surprise  phenomenon  is  considered,  then  a  readiness 
distribution  model  can  be  derived  as  follows: 


Let  D  (0 ) 


Number  of  interceptors  ready  to  engage  in 
combat  at  the  time  of  attack. 


m 


i 


iW 

V 


m 


§ 


4 


•m 


i 


1 

m 


:iVi 


Then : 


P  { D ( 0 )  =  j}  = 


for  0  j  <  a 


l  11  i  for  .j  = 


(2.8) 


otherwise 


This  assumes  that  attacks  occur  infrequently,  so  a  steady- 


state  distribution  prevails,  and  that  there  is  essentially  no 


warning . 


b.  Partial  Surprise 


Suppose  that  the  intelligence  data  analysis  indi¬ 


cates  that  the  enemy  might  strike  after  W  units  of  time  (e.g.. 


days) .  Assume  that  W  is  a  random  variable  distributed  exponen¬ 


tially  with  mean  n  •  During  such  a  time  period  the  squadron 


will  undergo  a  mobilization  and  preparedness  stage,  and  the 


squadron  activities  will  change.  They  will  eliminate  training 


and  conduct  air  reconnaissance  and  early  warning  missions 


only,  and  they  will  change  (enhance)  the  maintenance  repair 


capability.  Such  changes  are  assumed  to  cause  the  failure 


rate  to  decrease  and  the  repair  rate  to  increase. 


Assume  that  the  failure  rate  decreases  from  A  to 


A'  where  A  >  A',  and  that  the  repair  rate  increases  from  p  to 


p 1  where  p  <  p  '  . 


Let  X (t )  be  the  number  of  modules  available  at 


time  t  with  the  new  rate  parameters.  Therefore,  the 
(X(t)  ,  t  >_  0}  is  a  continuous-time-Markov  process  with  the 
following  rate  parameters: 

|  A'i  for  i  =  0,l,...,a-l 
A!  =  A'  xmin{a,i}  =  j 

*  A ’ a  for  i  =  a  , .  .  .  ,M 

and 

,  y  1 R  for  i  =  0,1,..., M-R 

Vi!  =  u'  xmin{R,M-il 

(  p'(M-i)  for  i  =  M-R+l , . . . ,M 

The  initial  condition  for  (X(t),  t  >_  0}  is  the 
limiting  distribution  for  {X(t),  t  _>  0},  i.e.,  set  of  equations 
(2.7)  . 

P{X(0)  =  i}  =  7Ti  i  =  0,1,2,..  .,M  (2.9) 

Therefore,  (X(t),  t  ^  0}  is  a  birth-and- death 
process  with  initial  conditions  tt^  for  i  =  0,1,..., M.  Let 

P.  . (t)  =  P{X(t)  =  j | X (0 )  =  i} 

1  >  3 

The  forward  Chapman-Kolmogorov  equations  for 
{X  (t)  ,  t  0 }  are  : 
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:S 
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api^t) 

dt 


3tPi,j<t)  * 


-(Xj+’,j>Pi.j(t)  +  "j-lpi,j-l(t) 


fePi,o(t)  - 


+  x;+ipi,J+i(t> 


+  xipi.  (t> 


(2.10) 


Let  P.  . (s)  be  the  Laplace  transform  for  P.  . (t) 

^  1,1 


P.  •  (s)  =  /  e-sc  P.  .  (t)  dt 

1  9  j  Q  1  /  J 


To  find  the  readiness  probability  distribution  at 
the  time  of  attack,  it  is  required  to  find  the  probability 
distribution  for  the  number  of  modules  available  at  the  time 
of  attack.  Let 


P.  . (W)  =  P{X(W)  =  j [ X (0 )  =  i,w} 

x  t  J 


Now  note  that 


E[P.  .  (W)  ]  =  /  P.  .  {w)ne'nwdaJ  =  n  /  e“nuP.  .  (u>)doj 

1  9  J  q  1  *  J  0  1  '  J 


E[P.  . (w) ]  =  n  P:  , (n)  , 

1  r  J  1  f  J 


(2.n: 


so  that  the  required  readiness  is  given  in  terms  of  a  Laplace 


transform. 


Taking  the  Laplace  transforms  of  (2.10)  and  inte¬ 


grating  by  parts  yields: 


("i+s)-pi,o(s)  +  »ipi,l<S)  -  -pi,ol0> 


(M+uj+s,pi.j(s)  +  ‘,i-iPi,j-i(s) 


+  M+ipi.i+i(s)  =  'pi.j<0> 


(2.12) 


i  £  j  _<  M-l 


(uA+S)Pi,M(s)  +  -  -Pi,M<0) 


where : 


pi,i(0>  *  i 


1  if  j  =  i 


0  otherwise 


The  readiness  probability  distribution  can  be 
calculated  by  solving  for  P{X(W)  =  j|W},  j  =  0,1,..., a,  from 
the  above  system  of  linear  equations  using  (2.11)  together 
with  the  initial  distribution  for  the  restricted  process 
(X(t),  t  £  0}  given  by  (2.9). 


From  the  law  of  total  probability, 


M 

P{X(W)  =  j I W}  =  l  p{x (W)  =  j , X (0 )  =  i | w} 

i=0 


M 

=  l  P(X(W)  =  j  [  X  ( 0 )  =  i,W}P{X  (0)  =  i} 
i=0 


Thus : 


M 

P{X(W)  =  j  J  W }  =  l  TT  P{X(W)  =  j  I X  ( 0 )  =  i,  w}  (2.13) 

i=0  1 


Taking  the  expectation  of  both  sides  of  (2.13) 
with  respect  to  W,  we  obtain  the  following: 


M 

E  [P{X  (W)  =  j|w}]  =  l  it  .  E  [P  { X  (W)  =  j  |  X  (0  )  =  i,W}] 

i=0  1 


Using  equation  (2.11),  we  get: 


M  C 

e [p { x (w)  =  j  | w } ]  =  n  l  tt.p.  (n)  (2.14) 

i=0 


Hence,  the  readiness  probability  distribution  is 


given  by: 


ft 


I 


P(D(0)  =  j}  = 


n  J  tt  p  (n: 

i=0  1  1,3 


M  M 


n  l  l  k(n) 

k=a  i=0  1  1,K 


0  <  j  <  a 


j  =  a 


otherwise 


(2.15) 


d 


2.  An  Illustration  for  the  Single-Module  Logistics  Model 


The  following  basic  data  and  assumptions  were  used  as 


& 


S 


an  example  for  the  Single-Module  Logistics  model  illustration: 

An  aircraft  requires  one  type  of  module  to  be  considered 
as  a  mission  capable  aircraft. 

The  squadron  is  assigned  a  =  4  aircraft. 

The  total  number  of  modules  assigned  to  the  squadron 
is  M  =  6. 

The  maintenance  commander  is  assigned  2  repairmen 
(crews)  . 

An  aircraft  is  reported  down  at  a  rate  of  A  =  1  aircraft 
per  day,  during  peacetime,  and  becomes  A'  =  0.5  aircraft 
per  day,  during  the  warning  time,  if  a  partial  surprise 
scenario  is  considered. 


Modules  are  repaired  at  a  rate  of  y  =  0.5  modules  per 
day  during  peacetime,  and  y'  =  1  module  per  day  during 
the  warning  time  if  a  partial  surprise  scenario  is 
considered . 

The  expected  time  for  the  warning  period  (i.e.,  time 
until  the  attack)  is  n~^  =  6  days. 

For  illustration,  both  classes  of  surprise  attacks 

will  be  considered. 


State:  i=0  1  2  3  4  5  6 

7T  ( i )  =  .3676  .3676  .1838  .0613  .0153  .0038  .0005 

Then  using  equations  (2.8),  we  can  compute  the 
squadron  readiness  probability  distribution.  This  was  found 
to  be : 

Number  of  oper¬ 
ational  aircraft:  j  =  0  1  2  3  4 

P{D(0)  =  j)  =  .3676  .3676  .1838  .0613  .0196 

This  means  that  under  the  total  surprise  scenario, 
the  probability  of  the  squadron  having  no  aircraft  ready  to 
engage  the  incoming  threat  is  .3676,  the  probability  of  having 
one  aircraft  operational  is  .3676,  and  the  probability  of  having 
two  aircraft  operational  is  .1838,  etc.  Note  that  the  median 
number  of  aircraft  ready  to  engage  is  less  than  1;  and  the 
expected  number  of  aircraft  ready  to  engage  is  .9387  aircraft 
which  is  also  less  than  1.  This  suggests  that  the  squadron 
must  prepare  for  combat  in  order  to  survive, 
b.  Partial  Surprise 

A 

The  Laplace  transform  P.  .(n)  was  found  to 


2 


3 
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\j 
i  \ 

0 

1 

2 

3 

4 

5 

6 

0 

.6748 

.9240 

1.1146 

1.1209 

.9404 

.8383 

.  3869 

1 

.2310 

1.0011 

1.2075 

1.2143 

1.0188 

.9082 

.4192 

2 

.1393 

.  6037 

1.3313 

1.3389 

1.1233 

1.0013 

.4622 

3 

.1051 

.4554 

1.0042 

1.5127 

1.2692 

1.1314 

.  5222 

4 

.0882 

.  3821 

.8425 

1.2692 

1.4843 

1.3232 

.  6107 

5 

.0786 

.  3406 

.7510 

1.1314 

1.3232 

1.6252 

.  7501 

6 

.  0725 

.3144 

.  6932 

1.0443 

1.2214 

1.5002 

1.1539 

Therefore  the  E[P.  . (W) ]  is: 

i#3 


Thus  P { X ( W )  =  jfX(0)  =  i|W}  is  given  by 


j 

i 

0 

1 

2 

3 

4 

5 

6 

0 

.0414 

.0566 

.0683 

.0686 

.0576 

.0514 

.0237 

1 

.0142 

.0614 

.0740 

.0743 

.0624 

.0556 

.0257 

2 

.0043 

.0185 

.0407 

.0410 

.0344 

.0307 

.0142 

3 

.0011 

.0047 

.0103 

.0154 

.0130 

.0115 

.0053 

4 

.0002 

.0010 

.0021 

.0032 

.0038 

.0034 

.0016 

5 

0 

.  0002 

.  0006 

.0007 

.0008 

.0010 

.  0006 

6 

0 

0 

.0001 

.0001 

.0001 

.0001 

.0001 

Therefore , 

6 

P{X(W)  =  j | W}  =  l  P{X(W)  =  j,X(0)  =  i | W} 

i=0 

which  is  given  by  the  following  table: 

State :j  =0  1  2  3  4  5  6 

P{X(W)  =  j  j  W}  =  .0612  .1424  .1961  .2033  .1721  .1537  .0712 

The  readiness  probability  distribution  becomes: 

Number  of  aircraft:j  =0  1  2  3  4 

P { D ( 0 )  =  j)  .0612  .1424  .1961  .2033  .3970 


Note  that  the  median  number  of  aircraft  ready  to  engage  has 
improved  to  approximately  3;  and  the  expected  number  of  air¬ 
craft  ready  to  engage  has  improved  to  2.7325.  This  is  a 


result  of  incorporating  the  warning  time,  and  considering  the 
new  parameters  for  the  process. 

Under  both  classes  of  the  surprise  scenarios,  we 
were  able  to  compute  the  readiness  of  the  squadron  measured 
in  terms  of  the  initial  distribution  for  the  number  of  aircraft 
ready  to  engage  in  combat. 

G.  TWO-MODULES  PROBLEM  FORMULATION 

Consider  an  aircraft  squadron  that  consists  of  a  number, 
a,  of  failure-prone  aircraft.  Each  aircraft  requires  each  of 
two  modules  (e.g.,  an  engine  system,  and  an  avionics  system) 
to  be  considered  mission  capable.  Let  p^ ,  p2  and  p^2  be  the 
conditional  probabilities  that,  when  an  aircraft  is  reported 
down,  it  requires  respectively.  Type  1,  Type  2,  or  both  types 
of  repair,  where  p^  +  p2  +  p12  =  1.  Let  A  denote  the  overall 
Markovian  failure  rate  of  an  aircraft.  Suppose  that  there  are 
M^  and  M2  modules  of  Type  1  and  Type  2  respectively  assigned 
to  the  organization,  where  min{M-^,M2}  >_  a.  Furthermore  there 
are  R-^  and  R2  repairmen  (crews)  capable  of  repairing  modules 
of  Type  1  and  Type  2,  respectively,,  and  only  one  repairman 
(crew)  can  work  on  a  failed  module  at  any  time. 

Let  X-^  (t)  and  X2  (t)  denote  the  number  of  modules  of  Type 
1  and  Type  2  that  are  awaiting  or  undergoing  repair  at  time  t. 
Thus  the  number  of  mission-capable  aircraft  is  min{a ,M^-X^ (t) , 
M2-X2(t)}.  This  is  the  number  of  aircraft  that  are  failure 
prone;  the  others  are  awaiting  either  a  module  of  Type  1  and/or 
a  module  of  Type  2.  This  formulation  tacitly  assumes 
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instantaneous  cannibalization,  so  that  one  aircraft  will  not 
be  awaiting  a  Type-1  module  only,  while  another  aircraft 
awaiting  a  Type-2  module  only.  A  Type-1  module  can  be  canni¬ 
balized  from  the  latter  aircraft  and  installed  on  the  former 
aircraft  resulting  in  one  aircraft  operational. 

Finally,  it  is  assumed  that  repair  in  both  shops  is 
Markovian  (or  exponential)  where  p  ^  and  p2  denote  the  repair 
rates  at  which  individual  repairs  of  Type-1  and  Type-2 
modules,  respectively,  are  completed.  Figure  (2.2)  shows  a 
schematic  of  this  system. 

Once  X^(t)  and  X2  (t)  are  known,  then  the  number  of  modules 
of  both  types  in  any  category  can  be  determined  from  the 
Markovian  assumptions. 

(i)  The  number  of  modules  operating  is  min{a,M..-X,  (t)  , 
M2-X2(t)} 

(ii)  The  number  of  spares  of  Type  i  is  max{0,M.-X.  (t)-a), 

i  =  1,2  11 

(iii)  The  number  of  modules  in  repair  at  shop  i  is 
min{Ri,Xi (t) } ,  i  =  1 , 2 

(iv)  The  number  of  modules  of  Type  i  waiting  for  repair 
is  max { 0 , X^ ( t ) -R^ } ,  i  =  1,2 

Thus  the  number  of  modules  in  any  category  can  be  determined 
once  X^  (t) ,  i  =  1,2,  are  known. 

The  transition  probabilities  of  the  process  {X^ (t) ,X2 (t) ; 
t  >  0},  of  order  dt  are  given  below: 


Capacity  =  a  air¬ 
craft 


X_  (t)  =  Number  of  modules  X  (t)  =  Number  of  modules 

2  down  of  Type  2  down  of  Type  1 


Figure  2.2.  Schematic  of  the  Two-i"odules  Logistics  System 
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t 

t+dt 

Probability 

(i/ j ) 

(i+1 / j ) 

P-^A  min  {a  ,M^-i  ,M2~  j  }dt 

-> 

( i , j+1) 

P2A  min (a ,M^-i ,M2~j }dt 

->• 

(i+1 , j+1 ) 

P12A  min {a  ,M^-i ,M2” j }dt 

-> 

(i-1, j ) 

min  { ,  i}dt 

(i, j-1) 

y2  min  (R2  ,  j  }dt 

{ X^  (t)  ,X2  (t)  ;  t  ^  0}  is  a  finite  state  space  continuous- 
time-Markov  process.  All  states  of  the  process,  defined  by 
(2.16),  communicate,  so  the  Markov  process  is  irreducible. 
Hence,  by  Theorem  (2.1),  the  limiting  distribution  exists, 
and  can  be  found  by  solving  a  system  of  linear  equations.  The 


1.  Formulation  I 


— 

I 

Under  this  formulation,  it  is  assumed  that  the  two 
modules  fail  independently.  The  assumption  states  that  an 
aircraft  requires  only  one  of  the  two  types  to  be  considered 
a  mission  capable  aircraft.  That  is,  as  long  as  there  is  one 
module,  regardless  of  its  type,  installed  on  the  aircraft 
then  the  aircraft  can  perform  its  mission.  Suppose  that  the 
rate  parameters  are  given  by: 


fv(j)  =  Pi,  A  min{  a  ,  M,  -  j  } 


k  =  1,2 


gv(j)  = 


I  V  i  - 1'2 . V1 


pkRk  j  =  Rk, . . . ,Mk 


k  =  1,2 


where  p^+  -  1 . 

Under  the  above  assumption,  the  marginal  processes 
{X-^(t),  t  ^  0}  and  (X2(t),  t  >_  0}  are  two  independent  birth 


and  death  processes. 

Define  P . . (t ) 
il 

the  kfc^  process,  k  = 
started  in  state  i. 


to  be  the  conditional  probability  of 
1,2,  being  in  state  j  given  that  it 
Then 


=  P { X,  ( t )  =  j  I  X.  (0)  =  i}  k  =  1,2 


Let 


Pj  (t) 


55 


The  forward  Chapman-Kolmogorov  equations,  using  the 
same  probabilistic  argument  as  in  the  Single-Module  Logistics 
formulation,  are  given  by: 


dP*(t) 

dt 


dpj(t) 

dt 


<(t) 

dt 


-(fk(j)+gk(j)  )Pj  (t)  +  fk (j-Dpj_i (t) 

+  gk(j+DPj+1(t)  i  i  j  i  Mk-i 

-fk(0)p£(t)  +  gk(l)pj(t) 

^k(Mk)PMk(t)  +  fk(Mk-1)PMk-l(t) 


(2. 


with  initial  condition: 


if  j  =  i 

k  =  1,2 

otherwise 


a.  Limiting  Distribution  for  Formulation  I 

1c  th 

Let  tt_.  denote  the  long  run  probability  of  the  k 

process,  k  =  1,2,  being  in  state  j.  Then: 

it ^  =  lim  P^  .  (t)  k  =  1,2 

dP*(t) 

If  the  limits  exist,  then  lim  — ^ — 

t-*00 

the  forward  Chapman-Kolmogorov  equations  become: 


18) 


0,  therefore, 


0 


•fk(0)^  +  gk(l)^ 


(£k(j)+gk(j)  )”j  +  £k < j-D 71  +  5k<j+Di!j+1  =  o 


1  £  j  £  Mk-1 


■gk(Mk),,Mk  +  £k(Mk-1),TMk-l 


M, 


=  0 


l  <  =  1 

j=o  J 


(2.19) 


where  the  last  expression  is  the  normalizing  equation. 

The  marginal  processes  (Xk(t),  t  _>  0},  k  =  1,2, 
can  be  viewed  as  independent  closed  migration  processes. 
Hence,  the  joint  distribution  is  equal  to  the  product  of  the 
marginals,  which  are  given  by  (2.19). 

Let  be  the  limiting  distribution  for  the 

joint  process  { (t)  ,X2  ( t)  ;  t  >_  0}  .  Then: 


TT  .  . 
11 


1  2 
TT  .TT  . 

1  1 


Therefore,  we  get: 


B 

*00  ml~i  m2-i 

n  f.  (n)  fl  f_  (n) 
n=0  n=0 


TT 


0j 


_ B _ 

M.  -1  M0-l 

1  1  2 

n  f  ^  (n)  n  g2  (n)  n  f 2  (n) 
n=0  n=l  n=j 


1  £  j  £  M2~l 
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QV* 

fry. 


^iO 


B 


j 


OM. 


TT  .  .. 
lM, 


Mlj 


i 

n 

n=l 

gx  (n) 

M^l 

n 

n=i 

f1  (n) 

M2-l 

n  fj (n) 
n=0 

B 

i 

n 

n=l 

gx  (n) 

Mi-1 

n 

n=i 

f  1  (n) 

j 

II  g~(n) 
n=l 

1  ±  i 

<  Mi~ 

1?  1  <  j 

B 

M.,-1 

n 

n=0 

M2 

f,  (n)  n 
n=l 

g2{n) 

B 

Mi 

n 

n=l 

gL  (n) 

m2-i 

n 

n=0 

f 2  (n) 

B 

i 

n 

n=l 

9±  (n) 

M^l 

n 

n=i 

f !  (n) 

m2 

n  g2(n) 
n=l 

B 

M1 

n 

n=l 

g:  (n) 

j 

n  g 

n=l 

f2(n) 

m2-i 

n  f2(n) 
n=j 

1  <_  i  £  M^-l 


m2-i 


n=j 


(2.20) 


1  £  i  <_  Mj^-1 


1  £  j  _<  M2-l 


where : 


k=l  \  Mk-1 


M,  -1 

.  1 _  +  y  _ i _ 

k  x  i=l  i  k 

n  fk(j)  n  gk(j)  11  fk(j 

j=0  j  =  l  j  i 


n  gk(j) 

j=i  k 


The  assumption  made  under  formulation  I  results 
in  a  very  simple  and  unrealistic  system,  because  an  aircraft 
requires  only  one  type  of  module  to  be  considered  as  a  mission 
capable  aircraft.  This  formulation  is  impractical  for 
aircraft  squadron  scenarios  where  the  objective  of  the 
maintenance  commander  is  to  maintain  the  highest  possi¬ 
ble  readiness  in  the  squadron.  The  above  formulation  could 
be  used  for  modelling  a  depot  repair  system  where  there  are 
multiple  types  of  modules  that  could  be  assumed  to  demand 
repair  independently.  A  generalization  of  the  above  method 
that  can  accommodate  the  depot  repair  scenario  is  trivial  and 
a  closed  product  form  solution  for  the  limiting  distribution 
of  the  joint  probability  can  be  found.  Suppose  there  are  N 
different  types  of  modules.  Then: 


nl '  • *  * ' nN 


naafUfiA&xui&i 


k=l  nk 


M,  -1 
k 


n  gk(j)  n  fk  ( j 

j=1  j=nk 


where : 


M,  -1 

k 


k  i=l  i  k 

n  fk(j)  n  gk(j)  n  fk(j) 

j=o  j=i  j=i 


n  gk(j) 
j=i  k 

2 .  Formulation  II 

Under  this  formulation,  it  is  assumed  that  p^2  =  0, 
i.e.,  there  is  no  simultaneous  failure  of  both  items.  Air¬ 
craft  can  be  reported  down  either  because  of  a  failure  of 
Type  1,  or  a  Type  2  module,  with  probabilities  p-j^  and  p2, 
respectively;  where  p^  +  p2  =  1.  Therefore  the  rate  parameters 
are  given  by: 


Pkf(i,j>  '  k  =  I'2 

where 

f(i,j)  =  A  min {a,M1-i,M2~j } 

while  g^(i,j)  and  g2(i,j)  are  the  same  as  given  by  equations 
(2.17)  . 

Define  { X-^  ( t )  ,  X2  ( t )  ;  t  >_  0}  to  be  the  number  of  modules  of 
Type  1  and  Type  2  down  at  time  t,  respectively. 
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{X^  (t)  ,^2  (t)  ,  t  >_  0}  is  a  bivariate  birth-and-death  process, 
operating  on  the  state  space  S  =  {  (0 , 0 (M-^  ,M2  )} .  Figure 
(2.3)  shows  a  graphical  representation  of  the  rates  of  transi¬ 
tion  between  states. 

It  is  clear  from  the  figure  (2.3)  that  state  (M^,M2) 
is  a  transient  state.  Hence: 


lim  P 

t+oo 


M  M 
12 


(t) 


0 


It  is  also  clear  that  once  the  state  vector  departs 
from  value  (M^,M„),  the  process  will  never  reach  (M^,M2) 
again.  So  unless  the  process  starts  in  state  (M^,M2),  this 
state  will  never  be  visited.  Since  the  initial  condition  is 
assumed  to  have  all  modules  up,  the  supervisor  can  never  ex¬ 
pect  to  have  all  modules  of  both  types  down  at  any  point  in 
time.  This  results  from  the  fact  that  under  this  formulation 
it  is  assumed  that  when  an  aircraft  is  down  awaiting  modules, 
it  is  waiting  for  one  module  only,  never  both  types.  This 
assumption  is  very  optimistic  and  it  doesn't  represent  a 
flight-line  logistics  operation.  Therefore,  it  was  concluded 
that  this  formulation  is  inappropriate  for  the  aircraft- 
squadron  logistics  problem. 

The  preceeding  two  formulations  suggest  that  a  simul¬ 
taneous  failure  mechanism  (i.e.,  p^2  >  0)  is  necessary  in 
order  to  provide  operational  realism.  This  is  carried  out 


g2(M1»D 


3.  Formulation  III 


Under  this  formulation,  it  is  assumed  that  the  condi¬ 
tional  probability  of  a  simultaneous  railure  of  both  Types 
(p^2)  is  positive.  {  (t)  , X2  ( t)  ,  t  >_  0}  is  a  bivariate 

birth-ano-death  process  with  parameters  given  by  (2.17). 

Define  Pnm  ^ (t)  to  be  the  conditional  probability  of 
the  process  being  in  state  (i,j)  given  that  it  started  in 
(n,m) .  Then, 


Pnm,ij(t)  =  p{Xi(t)  =  =  ^!Xi(0)  =  n,X2(0)  =  m} 


To  simplify  the  notation  we  suppress  the  initial  condition 
and  write. 


(t)  =  Pnm  .  .  (t)  . 
i]  nm, 13 


To  obtain  the  forward  Chapman-Kolmogorov  equations,  we 
write  the  probability  that  the  process  is  in  state  (i,j)  at 
time  t+dt  as  a  function  of  the  state  probabilities  at  time  t. 

The  probability  of  being  in  state  (i,j)  at  time  t+dt  is  expressed 
by : 


P.  .(t+dt) 

1  >  J 


=  (l-(f(i,j)  +  g,(i,j)  +  g~  (i , j ) dt) P .  .  (t) 

-L  £  ±  ,  J 

+  p1  (  f  (i-l ,  j  )  dtPi_1  Mt)  +  p12f  (i-1,  j-l)dt 
*  pi-l,j-l<t)  +  P2£<i.j-DdtPijj.1(t) 

+  gx  (i+1,  j)dtPi  +  1^j  (t)  +  92  (i'j  +  DdtPj^j  +  2  ( t ) 
+  o(dt) 
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Subtracting  P^j(t)  from  both  sides  and  dividing  by  dt,  and 
letting  dt  tend  to  zero,  gives  the  following: 


t.l 

VlV 


-■I. 


*>• 


m 


i*® 

m 


i 


m 


I 


Ui 

Ms 

’M*!1 


■»»;v 

4*y 

v % 


m 

4 


€ 


*?] 

d 


»  T,f  * 

t,  *  ■ 


dPQ,0(t) 


dPi,0(t) 


dP0,j(t) 


dP_(t) 


~f (0'0)P0,0(t)  +  gl(1'0)pi,0(t)  +  g2(0'1)P0,l(t) 


- { f ( i , 0 )  +  g1(i,0))Pi^Q(t)  +  pxf  (i-l,0)Pi_1 


+  g1(i+i,o)pi+1,0(t)  +  g2(i'1)pi,1(t) 


!<  i<  M1-l 


-  (f  (0  ,  j  )  +  g2(0,  j))P0>j  (t)  +  p2f(0,j-l)P0^._1(t) 

+  gi(1^j)p1/j(t)  +  g2(0'i+1)po,j+i(t) 


1  <  j  <  M2-1 


-  (f  (i ,  j  )  +  g1  (i ,  j  )  +  g2(i,  j))Pi^  (t) 

+  Plf(i-1'j)pi-l,j(t)  +  P12f(i-lfj-l)pi.ifj.1(t) 

+  P2f  (i,  j-l)Pi^_1  (t)  +  gx(i+l,j)Pi+1  (t) 

+  g2(i,j+l)P.j ,+1(t) 


1  £  i  £  M.-l,  1  <_  j  £  M~-l 


(2.21) 


dPi,M2(t) 


=  - (gx (i,M2)  +  g,(i,M,))P.  M  (t) 


2  2  '  i,M. 


+  P12f(l  1,M2"1)Pi-l,M2-l (t) 


+  p2f (i,M2-l) Pi#M^_1 (t) 


+  g.  (i+l,M„)P 


2  i+1 ,M, 


1  <_  i  <_  M^-l 


dPM1, j (t) 


dP.,  «  (t) 


- (gL (Mx , j )  +  g2(Mi,j))pM  j (t) 
+  P12f (M1_1' j-1)pMl-l, j-1 (t) 


+  g2 (m1, j+l)p 


Mx,j+1 


1  <  j  <  M2-l 


-(g1(M1>M2)  +  g2 (M1'M2) )PMl,M2 (t) 
+  P12f (M1~1'M2'1)PMi_1,m2-1 (t) 


with  initial  conditions: 


{  1  if  i  =  j  =  0 


pi.j(0>  ■  | 


0  otherwise 


The  bivariate  continuous-time-Markov  process 
{X^  ( t )  , X2  ( t)  ;  t  >_  0}  has  already  been  shown  to  have  a  limiting 
distribution.  Define  to  be  the  limiting  probability  of 

the  process  being  in  state  (i,j),  i.e.. 


lim  P .  . (t ) 


Taking  the  limit,  as  t  °°,  in  the  forward  Chapman- 
Kolmogorov  equations,  gives  the  following  system  of  equations 


WWW 


■y 


0 


-f  { 0 , 0 )  tTqq  +  g^lfOJir^  +  g2(0,l)~01 

-  ( f  ( i ,  0)  +  g1  (i,  0)  )  TTi0  +  pj^f  (i-1,0)  Tri_1  Q 

+  g1(i+1,0)TTi+1^0  +  g2(i,l)fTil)  =  0 

~(f(0,j)  +  g2  ( 0  ,  j  ) )  ttq  j  +  p2f  (0,  j-l)n0^_1 

+  gx  (1,  j)7Tlj  +  g2  (0,  j  +  l)TT0f  j  +  i  =  0 


-(f(i,j)  +  g1(i/j)  +  g2  (i  ,  j  )  )  tt—  +  P-j^f  (i-lf  j 

+  P12£<i-1-3-l)',i-1,j-i  +  P2f 
+  giU+l,j)ir1+l(j  +  g2(l,j+l).i>j+1  =  0 


(2.22) 


(Cll  <i,M2>  +  92<i.M2))"iiM2  +  Pl2£(i-l'M2‘1),'i-l,M2-l 

+  p2£(i,M2-l)n  M  ,  +  gi(i+l,M2)iri+i  =  0 


(9ltMl'j)  +  <32(Ml'3),,M1,j  +  Pl£(Mr1'3)'M1-l,j 

+  Pi2£(Hi-1'j-1)"n1-i,j-i  +  g2(M1/j+i)’'„l>j+1 


=  0 


j1(M1+M2)  +  g2  <M1  »M2)  )7TM1,M2  +  p12f(Ml  1,M2~1)lTM;L-l,M2-l 


M1  M2 


l  l  7T.  .  =  1 

i=0  j  =  0  ^ 


Therefore,  it  is  required  to  solve  (M-^  +  l )  (M2  +  l )  linear  systems 
of  equations  to  compute  V  (i,j)  S.  The  size  of  the 


’J’.  ■">  -  Cj 


system  of  equations  tends  to  be  large  as  and  M ^  increase* 
For  example,  if  there  are  50  modules  of  both  types,  the  system 
has  2,601  equations.  Thus,  for  a  large  maintenance  system, 
the  above  approach  would  be  infeasible  to  follow.  Therefore, 
another  approach  is  desirable.  The  Matrix  Geometric  Method 
of  M.  Neuts  (1981)  is  the  alternative  pursued  here. 

H.  MATRIX  GEOMETRIC  APPROACH 

Following  the  approaches  in  Neuts  (1981),  and  Gani  and 
Purdue  (1984),  we  now  formulate  the  continuous  time  Markov 
process  model  for  the  two-module  logistics  problem.  This 
formulation  facilitates  computations  for  modules  of  realistic 
number . 

Consider  {X.^  (t)  ,X2  (t)  ;  t  >  0)  as  a  Markov  process  on  the 
state  space  {SM  , SM  , . . . , ,SQ }  defined  below. 

SM  =  (  (Mjl  ,  0  )  ,  (Mq  ,  1 )  ,  ,  (M1 ,  M2  )  } 

SM  _i  -  { (Mj-1,0) , (M1-l,l) , . . . , (M1-1,M2) } 


S1  =  { (1,0) , (1,1) , . . . , (1,M2) } 

s 0  =  {  (0,0)  ,  (0,1)  , .  .  . ,  (0,M2)  } 
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m 

m 


m 


=  1PMlfO(t,'PMlfl(t) . PMrM2(t)> 


V(t)  =  {p 


M^-1,0  (t)  '^-1,1  (t)  '  *  *  *  ' PM1-1 ,1 


pi(t)  "  {P1,0 (t)  'Pl,l  (t)  ' ‘ ' ' ,pi,m2 (t)  } 


po(t)  ^po,o (t) ,po,i ^ ' • *  * ,po,m2 


Define  the  following  matrices: 


f (n,0) 


f (n,l) 


f (n,M0-l ) 


gx  (n, 0) 


gx  (n,l) 

\ 

V 

\ 

gx (n,M2) 


g2  (n,l) 

\ 

\ 

S 

\ 

g2 (n,M2) 

Let  Q  be  the  infinitesimal  generator  for  the  Markov 
process  {X^ (t) ,X2 ( t)  ;  t  ^  0}.  Then  Q  will  be  a  block  tri¬ 
diagonal  matrix  as  follows: 


where  B  ,  C  ,  and  D  are  square  matrices  of  order  M~  +  l.  The 
n  n  n  2 

diagonal  elements  of  the  diagonal  matrices  Bn  are  strictly 

negative  and  are  determined  so  that  the  row  sums  of  Q  are  zero. 

The  process  can  be  fully  defined  by  the  infinitesimal  generator 

and  the  initial  condition.  Therefore,  we  need  to  determine 

all  of  the  elements  of  B  .  C  and  D  . 

n  n  n 
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The  forward  Chapman-Kolmogorov  equations  are  given  by: 


4 


wc 


1 


Jt  P(t)  =  P  ( t)  Q 


1 .  e  .  , 


at[po(t)  pi<t3 


PML(t)3 


[P0(t)  Px(t) 


•  PMx(t)] 


B0  C0 


D1  B1  C1 


°M1-1  \-l  S^-l 


M, 


B 


M, 


Hence,  the  forward  Chapman-Kolmogorov  equations  become: 


dt  ^0(t) 


PQ ( t) Bq  +  P1(t)D1 


at  *n“> 


Pn-l(t)Cn-l  +  Pn(t)Bn  +  Pn+l(t)Dn+l 


(2.23) 


1  £  n  £  M^-l 


at  pMl(t)  = 


P  w  1  (t)CM  .  +  PM  (t)BM 
Mf-l  M^-l 


From  equations  (2.21),  we  can  obtain  the  equations  for 


Pn(t),  (n  =  and  expressing  these  in  matrix  form 

gives ; 


d  + 


dtPM1(t)  *•* 


-gx  (1^,0) 

g2(M1,l)  -(g-j^  (M^l) ) 


g2(M1,M2) 


+  [PK1-l,C(t)  **• 


Plf(Ml_1'0)  P12f (Ml-1'0) 

Plf  Pi2f  (Mi-1'1) 


plf  (Ml-l^-l)  p12f  (^-1,^-1) 

0 
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X 


-(f  (n,  OJ+g^n,  0))  p2f(n,0) 

g2(n,l)  -(f  P2f(n,l) 


\ 


N 


\ 


g2  (n,^— 1)  -(f  (n,M2~l)4g1(n,M2-l)4g2(n,M2-l))  p^Oi^-l) 

g2(n,M2)  -(g1(n,M2)+g2(n,M2) ) 


+  [Pn+l,0 (t)  Pn+l,M2(t)] 


g-L  (n,0) 
g-,  (n,l) 

N 


X 


g-j^  (n,^) 


+  [Pn-l,0 (t)  •••  Pn-l,M2(t)] 


P1f(n-1,0)  p12f(n-l,0) 

p1f(n-l,l)  p12f(n-l,l) 


\ 


\ 


p-j^f  (n-l^-l)  p12f  (n-l^-l) 

0 


for  n  =  1 , . . . 
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g2  (0,^-1)  -(f(0,M2-l)-Hg2  (0,^-1))  p2f  (0,^-1) 


g2(0,M2)  -g^O,!^) 


+  tPi,o(t)  • 


gxd,o) 


g1d,D 


g^l,!^) 


Therefore  we  get  the  following  sec  of  equations: 


at  po(t) 


ft  Pn(t) 


PQ  (t)  (- (F  (0)+G^0)  )+G20)  AT+p2F(0)  A]  +  P1(t)G;[1) 


5n-l<t) (PlFln'1)+Pl2F(n'1)A) 

+  P  (t)  [- (F  (n)  +G,(n)  +G^n))+G^n)  AT+p;)F  (n)  A] 
n  12  2  2 


+  ?„+i(t)Gin+l) 


(2.24) 


at  PM1(t)  =  PMrl(t)[PlF 


(M^l) 


(M  -1) 

+p12F  A] 


(M. 


-►  (M^)  (M2)  rp 

+  PM  (t)  [~(G1  +G2  *  )+G2  1  A  ] 
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with  initial  condition: 


P0(0)  =[10 


0]  ,  Pn  (0)  =  0 


1  £  n  <_ 


Thus,  by  comparing  the  system  of  equations  (2.24)  to  (2.23), 
we  have  the  following  result. 


Proposition  (2.1) 

The  Bivariate-Birth-and-Death  process  { X-^  ( t)  , X2  ( t )  ;  t  ^  0) 
for  the  Two-Module-Logistics  model  with  simultaneous  failure 
has  infinitesimal  generator 


Q  = 


where : 


B0  C0 
D1  B1  C1 


°M1-1  ^-1  S^-l 


M, 


B 


M, 


B, 


=  [-(F(0)+G<0))  -  G'°'aT  +  P,F 


(0) 


A] 


(n  =  0,1, - ,M1) , 


D  =  G,(n)  1  <  n  <  M, 

n  1  —  —  1 

Therefore,  by  knowing  F^,  G^11^  and  G^1^ 
we  can  use  the  above  proposition  to  construct  the  infinitesi¬ 
mal  generator,  and  hence  the  Chapmah-Kolmogorov  equations. 
Now,  we  are  ready  to  find  the  limiting  distribution  for  the 
process  by  adapting  the  argument  from  Gaver ,  Jacobs  and 
La touche  (1984). 

1 .  The  Limiting  Distribution 

The  Markov-process  { X^  ( t)  ,  X2  ( t )  ;  t  ^  0}  has  been 
shown  to  have  a  limiting  distribution.  Let 

tt  =  lim  P  (t) 
n  .  n 

t***00 

as  t  ->  °°,  we  get: 

lim  P  (t)  =  (5 

t-«  dt  n 

Therefore,  from  (2.23),  it  follows  that: 


Vo  +  *1D1  =  3 


7T  .C  -,+ttB  +  TT  -D  ,  =  0  1  <  n  <  M. -1 

n-1  n-1  n  n  n+1  n+1  —  -  1 


(2.25) 


TTM  n  C.,  +  IT..  B„  =  0 

Mi~l  M^-l 
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From  the  third  line  in  (2.20),  we  get: 


Thus : 


M, 


'7Tm1-icm1-i 


^  -  J«rlCMrl'-H^  > 


From  the  second  line  in  (2.25),  when  n  =  M.^-1,  we  get: 

it..  Dw  =  (5 


TT «.  ^  '  7T •  *  i  B..  i  *4"  7T--  D.,, 

M^-2  M^-2  M^-l  M^-l 

Substituting  (2.26),  we  obtain: 


(2.26) 


TTM1“2CM1~2  +  V^l^-l  +  1TM1-1CM1-1("HM1)DM1  ° 


Therefore : 


"Mj-l^Mj-l  +  S^-l 


_1TM1-2CM1-2 


M,  -1 


7rM1-2CM1-2  (_HM^-1) 


where : 


The  claim  is  that: 


where : 


IT 

n 


TT  ,C  -I  (-H_1) 
n-1  n-1  n 


I 

» 

i 

i 


H 


n 


B  +  Cn  )  D 

n  n  n+1  n+1 


We  will  prove  this  by  mathematical  induction.  We  know  from 
equation  (2.26)  that  the  statement  is  true  for  n  =  . 

Suppose  it  is  true  for  n  =  i.  We  need  to  show  that  the  state¬ 
ment  is  true  for  n  =  i-1.  From  the  second  line  of  (2.20), 
we  get: 


"i-2Ci-2  *  "i-lBi-l  +  Vi 


5 


Therefore : 


tt  .  „C.  +  it.  .  B  .  .  +  if.  C.  , (-H.^)D.  =  (5 

1—2  i—2  l-l  l-l  i-l  l-l  l  l 


TT.  ,  [B.  -  +  C.  ,(-HT1)D.]  =  — TT  .  0C  .  _ 

i-l  i-i  i— i  i  i  i-Z  i— 2 


-+  ->>  —1 
TT  .  =  -TT  .  0C  .  0  [-H  .  t  ] 

l-l  1-2  1-2  i-l 


which  proves  the  statement  is  true  for  n  =  i-l 
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In  the  case  of  n  =  0,  we  have: 


"oB0  +  "l0!  ■  0 


;oBo  +  Vo'-HI1)Di  -  5 


Therefore : 


Vo 


d 


Thus,  we  have  proved  the  proposition. 

Proposition  (2.2) 

The  limiting  distribution  for  the  bivariate-Birth-and- 
Death  process,  for  the  Two  Module  Logistics  model  with  simul¬ 
taneous  failure  is  given  by  the  following  recursive  equations: 


*oHo 


d 


=  TT  ,C  ,  (-H-1  ) 
n-1  n-1  n  ' 


n 

M, 


}  TT  e  =  1 

L  „  n 
n=0 


1  £  n 


where : 


H  =  B  +  C  )  D 

n  n  n  n+1  n  +  1 


0  £  n  £  M^-l 
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[1  1 


1] 


and  Bn ,  C  ,  and  Dn  are  as  given  by  Proposition  (2.1). 

2 .  Algorithm  for  Computing  the  Limiting  Distribution 

The  following  algorithm  was  used  to  solve  the  recur¬ 
sive  equations  given  by  Proposition  (2.2).  The  algorithm  is 
based  on  the  one  given  in  Gaver,  Jacobs  and  Latouche  (1984). 
1.  Starting  with  ,  compute  recursively  the 


2. 

3. 


matrices  H  ,  for  0  £  n  <_  M^-l. 

->■  - V 

Solve  the  system  tTqHq  =  0,  iTne  =  1. 


0 


Compute  recursively  the  vectors  Tt^,  n  =  1,2,...,M.  ; 
and  renormalize  the  vectors  it's  so  obtained  at  each 
stage  (i.e.,  renormalize  each  time  a  new  subvector 
is  determined) . 

3 .  The  Laplace  Transforms 

Following  the  argument  in  Gani  and  Purdue  (1984)  we 

/v 

can  obtain  an  expression  for  Pn(s),  the  Laplace  transform  of 


->  00 

P  (s)  -  /  e-stP  (t ) dt 

n  >  „  n 


— s  t 

Multiplying  both  sides  of  (2.23)  by  e  and  integrating 
over  all  values  of  t,  we  get  the  following: 


(2.27) 


sPq  ( s )  -  eQ  =  P0(s)Bq  +  P^s^ 


sPn(s>  -  Pn-l(s)Cn-l  +  Vs>Bn  +  Pn+l(s)EVl 


SPM1(S)  ^^^-1  *S)CM1-1  +  PM1  ^ S  ^  BM1 


where  eQ  represents  the  initial  condition 


P0(0)  =(10  ...  0)  =  eQ 


si 


E  =  B  +  C  [-E  ~  J  D  , 
n  n  n 1  n+1  n+1 


0  <_  n  <_  M-j^-1 


E..  =  B..  -  si 


We  have  shown  (equation  2.28)  that  the  statement  is 
true  for  n  =  .  We  will  again  prove  the  claim  by  induction 

Suppose  that  the  statement  is  true  for  n  =  i.  We  will  show 
that  it  must  also  be  true  for  n  =  i-1. 

For  n  =  i-1,  we  get,  from  equation  (2.22)  that 


sPi-l<s)  -  Pi-2(s)Ci-2  +  Pi-l(s>Bi-l  +  Vs)Di 


But  from  the  induction  hypothesis, 


Vs)  -  pi-i<s>ci-i [-Ex  i 


Therefore : 


sPi-l(s)  =  Pi-2(s)Ci-2  +  Pi-l(s>Bi-l  +  Pi-l(s)Ci-l[-Ei  1 


[-(Bi_i+ci.1[-E‘1]Di-SI)]  =  Pi-2 (s)Ci-: 


Hence : 


* 


In  the  case  n 


0,  we  obtain  from  the  induction 


hypothesis , 


-1. 


P1(s)  =  P0(s)C0[-E1i] 


Substituting  into  the  first  line  of  (2.27),  we  get: 


SP0(S)  -  e0  =  P0<s)B0  +  P0(S)C0[-E-1]D1 


PQ (s) [-(B0+C0 [-E11] D1-sIJ  -  eQ 


P0(s)l-E0]  =  eo 


r> 

B 

$ 


We  summarize  these  results  as  Proposition  2.3. 

Proposition  (2.3) 

The  vectors  Pn(s),  n  =  0,1,..., are  determined  by 
the  equations: 


P0UH-E0]  =  eQ 


5n(s)  “  Vl(s,Cn-lI-Enl1 


where : 


j 

eQ  =  (1  0  ...  0)  j 


and  Bn ,  Cn ,  and  Dn  are  as  given  by  Proposition  (2.1). 

Proposition  (2.3)  can  also  be  used  to  find  the  limit¬ 
ing  distribution  as  follows: 

■+ 

tt  =  lim  P  (t)  =  lim  sP  (s) 

n  n  j~y  n 

t^00  s^O 

->• 

/\ 

Now,  multiplying  the  equations  for  ?n(s)  given  by 
Proposition  (2.3)  by  s  and  letting  s  -+  0 ,  we  obtain: 

lim  sPn(s)  [ — En ]  =  lim  se.  , 
s-0  u  s+0  u 

and 


I 


Multiplying  the  first  line  in  the  above  equations  by 
-1,  and  adding  the  normalizing  equation,  we  obtain  the  equa- 


'•V-- 
'»**', .1 


•Vi’ 


'I't 


m 


‘Wi 
>'fVl 


•  wl 

M 


as 


tions  for  the  vectors  iTn,  n  =  0,1/...,M^,  given  by  Proposition 


(2.2) 


Proposition  (2.3)  can  only  be  applied  if  the  process 


started  with  probability  1  in  state  (0,0).  However,  the 


analyst  may  need  to  calculate  the  Laplace  transforms  for 


the  process  with  different  initial  conditions.  In  particu¬ 


lar,  suppose  one  has  positive  probabilities  P{X^(0)  =  i, 

X_(0)  =  i I  for  all  states, 
z  - 


We  need  to  generalize  the  above  results  to  allow  for 


other  starting  conditions,  in  particular  to  allow  considera¬ 


tion  of  the  partial  surprise  scenario. 


Given  the  process  started  in  state  (i,j). 


Pi(0) 


X  —  0,1, .  .  «  ,  M. 


5k(0> 


for  all  other  k. 


where : 


e_.  =  (0  0  ...010  ...  0)  j  =  0 ,1,  .  .  .  ,M2 


The  i  element  of  e^  is  equal,  to  1  whenever  the 


process  starts  in  state  (i,j). 


t 

( 


For  the  vectors  from  n  =  M,  down  to  n  =  i+1  of  P  (s) 

1  n 


we  can  use  the  results  from  Proposition  (2.3) 


Vs) 


=  Pn_-]_  (s)  Cn_-j_  C  — J  for  n  =  i+l,...,M, 


Now,  applying  the  argument  in  Gaver ,  Jacobs,  and 
Latouche  (1984)  to  equations  (2.23),  we  obtain: 


sP.(s)  -  e.  =  +  Pi(s)Bi  +  Pi+1(s)Di+1 


Therefore : 


P.(s)  =  P.  ,  (s)C.  ,  [-eTI]  +  e . ( — eT 1 ] 

l  l-l  l-l  l  j  l 


Mathematical  induction  can  be  used  to  show: 


(2.29) 


pi-k<s)  pi-k-l <s)ci-k-l t'Ei-k1 


for  0  <  k  <  i 


To  show  that  the  statement  is  true  for  k  =  1,  note 
that  from  equations  (2.23),  we  obtain: 


sPi-l (s) 


pi-2(s)Ci-2  +  Pi-l(s)Bi-l  +  Pi<s)Di 
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From  (2.29)  we  obtain: 


.1:' 

<S 


spi-l(s)  '  pi-2(s,Ci-2  +  Pi-l(s)Bi-l  +  Pi-l(s)Ci-l[-Ei  iDi 

+  ej'-EIllDi 


Si 

:Si 

& 

i’ 


4 


Pi-l(s)  -  Pi-2<s)Ci-2I_EI-lI  +  ej I'EIl,Dil"EI-lI  ■ 


Therefore  the  statement  is  true  for  k  =  1.  Suppose  it  is  true 
for  k=m,0<m<i.  We  need  to  show  that  it  is  true  for 
k  =  m+1.  From  the  induction  hypothesis  we  have, 


P.  _(s) 
l-m 


1  -I  XU  -i 

P.  m  l  (s) c .  m  ,  I-eT1  1  +  e.  [-eTX]  n  D  [-eT_  ] 

l—  m—  1  i— m— l  l— m  j  i  ^  i—  Jc+i  l  Jo 


For  k  =  m+1,  using  equation  (2.18), 


X. 

$ 


I 

% 


m 


j 


sP.  1  (s)  =  P.  _9  (S)C.  ,  +  P.  i  ( s )  B .  _  _  i  +  p.  (s)D 

i-m-1  x  m  4  x.  rn —  x. - m—  1  x  m  x.  1  m  x,  m 


=  P.  ,(s)C.  9  +  P.  , (s) B .  , 

l-m- i  i-m-2  i-m-1  i-m-1 


Therefore : 


+  P  .  -i  ( s )  e  >  -i  [— E  .  ]  D  . 

i-m-1  i-m-1  l-m  l-m 


+  e.[-E-l]  ^  V£+l[-EI-.lDi-m 


i  'I . —rn  ~ . .  i  ih)  n  ii  r  ~  i 


Pk  m  1 <s> 
i-m- 1 


P.  _ (s ) C .  -  [-E.  , ] 

i-m-2  i-m-2  i-m-1 


We  have  proved  the  following  proposition. 


Proposition  (2.4) 


The  vectors  Pn(s),  n  =  0,1,..., ,  given  that  the 


process  started  in  state  (i,j),  are  given  by: 


Vs) 


Ei-k(s)  *  fi-k-i(slci-k-i'-E'i-k' 


+  ej[-EI1’  “i-w'-'w1 


0  £  k  £  i-1;  i  £  n  £ 


pn(s> 


Vl(s)Cn-l>-En  1 


The  readiness  distribution  can  now  be  computed. 


a.  Total  Surprise. 


Under  the  Two-Module  Logistics  formulation,  with 


a  total  surprise  scenario,  a  readiness  distribution  model  can 


be  derived  as  follows: 


vr*  *  V*  :  ■;  )VY-  .H, 


0  <  k  <  a-1 


M,-k 


1  n  w 

i=0  1 ' M2~ 


M2-k-l 

k  +  i  =  0  X"k'j 


P{ D  (0 )  =  k}  = 


M1-a  M2-a 


I  I  *  i  -j 
i=0  j=0  1,3 


k  =  a 


(2.30; 


otherwise 


This  assumes  that  attacks  occur  infrequently,  so 
a  steady-state  distribution  prevails,  and  that  there  is  essen¬ 
tially  no  warning. 

b.  Partial  Surprise 

As  in  the  Single-Module  model  formulation, 
suppose  that  the  intelligence  data  suggests  that  the  enemy 
will  strike  after  W  units  of  time  (e.g.,  days).  Let  W  be  a 
random  variable  exponentially  distributed  with  mean  n  1 . 

Assume  that  during  the  time  W  the  failure  rate  decreases  from 
A  to  A 1  where  A  >  A',  and  repair  rates  increase  from  y^  and 
y2  to  y^  and  y2,  respectively,  where  y^  <  y|  and  y^  <  y£. 

Let  {X^  (t)  ,X2  (t)  ;  t  >_  0}  be  the  number  of  modules 
of  Type  1  and  Type  2  down  at  time  t.  The  process  {X^(t), 

X2  (t)  ;  t  >_  0}  is  a  bivariate-continuous-time-Markov  process 
with  rate  parameters: 
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f (i,j) 


A'  min {a ,M^-i ,M2~ j } 


91  (i/ j) 


j  i  1.2,... ,RX  1 

I  y-[Rl  1  =  R1  /  •  •  •  »M]_ 


92 (i» j) 


y  2  3  3  1 , 2 , . . . , R2_ 1 

y 2R2  3  r2 , • • • , M2 


(2.31) 


The  initial  distribution  for  {X^ (t) ,X2 (t) ;  t  >_  0} 
is  the  limiting  distribution  for  {X^ (t) ,X2 (t) ;  t  >_  0}  with 
parameters  A,  y^,  and  y2#  given  by  Proposition  (2.2): 


PtX^O)  =  i,X2(0)  =  j)  =  (i,  j )  e  S  (2.32) 

Therefore,  {X^  ( t)  ,X2  ( t)  ;  t  >_  0}  is  a  bivariate 

birth-and-death  process,  with  initial  conditions  it.  .  for 

i ,  3 

(i,j)  £  S.  Let 


nm 


,  i  j  (t )  =  P(X1(t)  =  i,X2(t)  =  j|X1(0)  =  n,X2(0)  =  m) 


and  P  . ■ (s)  denote  the  Laplace  transform  for  P  m  ..(t). 
nm, lj  nm, i] 


Then, 


To  find  the  readiness  probability  distribution  at 
the  time  of  attack,  it  is  required  to  find  the  number  of 
modules  of  both  types  down  at  the  time  of  attack. 

Let  ..(W)  be  the  conditional  probability  of 

the  process  being  in  state  (i,j)  at  W  (i.e.,  when  the  attack 
occurs)  given  the  process  was  in  state  (n,m)  initially,  and 
that  W  is  exponentially  distributed  with  mean  n  Therefore, 


It  follows  that: 


nP  ■  •  (n) 
nm,i] 


So,  as  in  the  case  of  the  single-module  model,  the  required 
readiness  is  given  in  terms  of  the  Laplace  transforms. 

In  much  of  what  follows,  for  simplicity  of  nota- 


! 

I 


tion,  we  will  suppress  the  initial  condition  and  write. 


and 


Pij(W)  =  Pnm,ij(W) 


Let 


?n(s)  =  (s) . PmM  (s)] 


nO 


nl 


nM, 


Using  Proposition  (2.4)  ,  we  find  that  the  vectors 
for  the  Laplace  transforms  for  the  new,  restricted,  bivariate 

~  A 

birth-and-death  process,  {X1 (t) ,X2 (t) ;  t  >  0},  P  (s)  ,  n  =  0,1, 
can  be  determined,  where: 


,<n) 


f (n,0) 


f (n,l) 


f (n,M2~l) 


(n) 


9]^  (n,0) 


g1 (n,l) 


g1 (n ,M2) 
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0 


(n) 


g2  (n,l) 


g2 (n,M2) 


The  readiness  probability  distribution  can  be 


calculated  by  solving  for  P{X(W)  =  i,X(W)  =  j|w} 


From  the  law  of  total  probability 


Mx  M2 


P[X(W)  =  i , X (W)  =  jjw}  =  l  l  P(X, (W)  =  i ,X_ (W)  =  j 

n=0  m=0 


X1  (0)  =  n,X2  (0)  =  m|  W} 


Mi  M2 


l  l  P{X.,(W)  =  i,X2(W)  =  j  1 XL  ( 0 )  =  n,X2(0)  =  m,  Wl 
n=0  m=0  ^ 


x  P(XX  (0)  =  n,X2  (0)  =  m} 


Therefore : 


P{X1 (W)  =  i,X2 (W)  =  j  I w}  = 


Mi  M2 


l  l  P{X  (W)  =  i,X2 (W)  =  j 
n=0  m=0 


Xi(0)  =  n  ,X2  (0)  =  m,W}TTn  ^ 


(2.33) 


Since  tt  is  non-random,  taking  the  expectations  of 

.a  ,m 


both  sides  of  (2.33)  with  respect  to  W,  gives  the  following: 


ft] 


Mx  M2 


e[p{x  (W)  =  i,x  (W)  =  j  I w} ]  *  n  l  l  *  p 

n=0  m=0  n'  n  ' 


ij(n) 


(2.35) 


Hence,  the  readiness  probability  distribution  is 


then  given  by: 


Mj-k  I^-k-l 

l  E[P.  m  _k(W)]  +  l  E[P  ,(W>]  0  <  k  <  a-1 

i=0  1,M2  i=0  \  K,D  “  “ 


P{D(0)  =  k}  = 


M1-a  M_-a 


1  1  E[P..(W)] 

i=0  j=0  J 


(2.36) 


otherwise 


In  terms  of  the  Laplace  transforms  the  above 


becomes : 


P{D(0)  =  k}  = 


Mj-k  M2 

Jo  n=0  Jo"n'I”P"'n,;i'M2'k(,l) 

Vk-1  ”i  «2  : 

"  n  jh  n=0  J0,'n,n.Pn,m;K1-k,j 


(2.37) 


Mj-a  M2 -a 

11  t  y  tt  p 

i=0  j=0  n=0  m=0  n,n 


0  <  k  <  a-1 


k  =  a 


otherwise 


«s 


4 .  A  Simple  Example  to  Illustrate  the  Proposed  Technique 


S 

| 


Consider  one  aircraft  in  operation.  Suppose  the  air¬ 
craft  is  operational  if  it  has  both  engine  and  avionics 
systems  (one  of  each)  installed  and  in  operating  condition. 
Suppose  further  that  there  are  a  total  of  2  engines  and  2 
avionics  systems  in  the  organization.  Both  engines  are 
assumed  to  be  repaired  by  an  engine  technician  that  is  not 
capable  of  repairing  the  avionics  system,  and  can  only 
work  on  one  system  at  a  time.  Suppose  that  the  organization 
has  a  single  engine  technician  and  2  avionics  technicians. 

Let  A  =  1  aircraft  per  day  be  the  total  failure  rate  of  the 
aircraft,  the  pilot  reports  failure  due  to  engine  with  proba¬ 


i 


a 


bility  p^  =  0.4,  and  due  to  avionics  failure  with  probability 
P2  =  0.4,  and  due  to  a  failure  of  both  systems  with  probability 
p>12  =  0.2.  Let  i-i =  1  engine  per  day  be  the  repair  rate  of 
the  engine,  and  =  1  avionics  systems  per  day. 

A  graph  of  the  state  space  and  the  transition  rates 
for  each  state  of  the  process  {X^ (t) ,X2 (t) ;  t  >_  0 }  is  shown 
in  Figure  (2.4)  . 

Consider  { ( t )  ,  X2  ( t )  ;  t  >_  0  }  as  a  Markov  process  on 
the  state  space  {S2,S^,Sq}  as  defined  below: 


S2  = 

{ (2,0) 

(2,1) 

(2,2)  } 

S1  = 

{ (1,0) 

(1,1) 

(1,2)  } 

S0  = 

{ (0,0) 

(0,1) 

(0,2)  } 
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Figure  2.4 


Transition  Rates:  A  Simple  Example 
to  Illustrate  the  Matrix  Geometric 
Approach 
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Let: 


P2(t)  =  {P2Q(t) ,P21(t) ,P22(t)} 


P1(t)  =  (P10(t)  ,P11(t)  ,P12(t)> 


PQ(t)  -  ^p00 ,P01 ^ ,p02 (t) * 


Define  the  failure  and  repair  matrices  F^,  G^  and 


G2n)  as  follows: 


',‘(1 

m 

,‘»j 

>*'4 

.cj 


(0)  _ 


10  0 


0  1  0  ,  F 

0  0  0 


10  0 


0  1  0  ,  G 

0  0  1 


,(D  _ 


(2)  _ 


10  0 


0  10 


0  0  0 


10  0 
0  10 


0  0  1 


/  »1 


0  0  0 


A  I 

ft 


.(2)  _ 


0  0  0 


Let 


A  = 

0 

0 

1  0 

0  1 

,  at  = 

0  0  0 

10  0 

0 

0  0 

0  10 

Let  Q  be  the  infinitesimal  generator  for  the  process. 
Therefore,  using  Proposition  (2.1),  we  get: 


where : 


Q  = 


B0  C0  0 
D1  B1  C1 
0  D2  B2 


" 

* - 

-1 

0.4  0 

B0  =  -(F(0)-H320))  +  d[0)AT  +  P2F(0)A  = 

1 

-2  0.4 

0 

2  -2 

-2  0.4 

0 

=  -(F<1,+g{1,4G^1))  +  G^AT  +  P2F(1)A 

= 

1  -3 

0.4 

0  2 

-3 

B2  =  “(g{2)+G22))  +  g2(2)aT  = 


-10  0 
1-2  0 
0  2-3 
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0.2 


0 


0.4  0.2 

0  0 

0.2 
0.4 
0 


Hence,  the  infinitesimal  generator,  Q,  becomes: 


(0,0) 

(0,1) 

(0,2) 

(1,0)  (1,1) 

(1,2) 

(2,0) 

(2,1) 

(2,2) 

(0,0) 

-1 

0.4 

0 

0.4 

0.2 

0 

0 

0 

0 

(0,1) 

1 

-2 

0.4 

0 

0.4 

0.2 

0 

0 

0 

(0,2) 

0 

2 

-2 

0 

0 

0 

0 

0 

0 

(1,0) 

1 

0 

0 

-2 

0.4 

0 

0.4 

0.2 

0 

Q  =  (1,D 

0 

1 

0 

1 

-3 

0.4 

0 

0.4 

0.2 

(1,2) 

0 

0 

1 

0 

2 

-3 

0 

0 

0 

(2,0) 

0 

0 

0 

1 

0 

0 

-1 

0 

0 

(2,1) 

0 

0 

0 

0 

1 

0 

1 

-2 

0 

(2,2) 

0 

0 

0 

0 

0 

1 

0 

2 

-3 

To 

following : 

compute  the 

limiting 

probabilities 

,  we 

need  the 

0 

0.2 

0 


^  ^  r.(°)  A  «  T7(°)  a  - 

C0  “  P1F  +  p12F  A  " 


0.4 

0 

0 


r  _  „<1)  .  n  P(l).  _ 

C1  “  pl*  +  p12  A  “ 


0.4 

0 

0 


n  -  r{1)  • 

D1  G1 


n  -  r(2) 

D2  "  G1 
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-1 


0 


0.0 


0.0 


H2  =  B2  = 


0 

1-2  0 
0  2-3 


;  H 


-1 


H1  -  B1  +  Ci<'H21)D2 


-1 

-0.5  -0.5  0.0 

-0.333  -0.333  -0.333 


-1.5  0.5  0.0 

1.2667  -2.7333  0.4667 

0  2-3 

_  _ i 


Therefore : 


-1 


H. 


-.8074 

-.4222 

-.2815 


«o  "  Bo  +  C0(-HI1)D1 


.1667  -.0259 
.5  -.0778 
■.333  -.3852 


-.5926  .5667  .0259 

1.2252  -1.7333  .508.1 

0  2-2 


From  Proposition  (2.2),  we  get: 


TrOCo  =  ^  '  ^O6  ^ 


Therefore : 


=  [.6175  .2987  .0839] 


vv-";1' 


=  [.3188  .1826  .0483] 
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To  renormalize. 


b  =  iT^e  +  fr^e  =  1.5497 


Therefore,  dividing  by  b  we  obtain: 


=  [.3985  .1927  .0541] 


=  [.2057  .1178  .0312] 


;2  =  ^c^-h-1) 


=  [.1343  .0520  .0079] 


To  renormalize. 


b  =  l  rr  e 
n=0  n 


=  1.1941 


Therefore,  we  obtain: 


?  =  [.3337  .1614  .0453] 


=  [.1723  .0987  .0261] 


tt2  =  [.1125  .0435  .0066] 


Therefore  the  readiness  is: 


P { D ( 0 )  =  0}  = 


2  1 

7  TT  .  0  +  l  TT-. 

i=0  x'2  j-0  2'3 
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Hence, 


P{ D  (0 )  =  0}  =  .234 


and 


P{D (0)  =  1}  =  .766 


Assume  there  is  a  warning  that  is  exponentially 


distributed  with  mean  =  1  day.  The  failure 

rate  during  this 

period  drops  from  A 

=  1  aircraft 

per 

day 

to 

A  ' 

=  0.5  aircraft 

per  day,  and  =  1 

,  u 2  =  1  modules  per 

day 

increase  to  = 

U2  =  2  modules  per 

day.  To  find 

the 

readiness 

at  the  time  of 

the  attack,  we  need 

to  determine 

the 

parameters 

of  the  new 

stochastic  process 

(X1(t)  ,X2(t)  ; 

t  >_ 

0}  . 

The  rate  parameters 

are  state  dependent 

as  follows: 

State 

(i»  j ) 

f (i, j ) 

*1 

(i. 

j) 

g2  (if j ) 

(0,0) 

.5 

0 

0 

(0,1) 

.  5 

0 

2 

(0,2) 

0 

0 

4 

(1,0) 

.5 

2 

0 

(1,1) 

.5 

2 

2 

(1,2) 

0 

2 

4 

(2,0) 

0 

2 

0 

(2,1) 

0 

2 

2 

(2,2) 

0 

2 

4 
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A  "’.'*'. -'  V  ' 


D  -  r(1) 

D2  G1 


2  0  0 
0  2  0 
0  0  2 


E2  =  B2  -  n1  =  2  -5  0 


-3  0  0 


0  4-7 


-.333  0  0 

-.1333  -.2  0 

-.0762  -.1143  -.1429 


h  =  B1  +  Clt_E21]D2  “  nI  = 


-3.34 


2.0686  -5.3971  .2286 

0  4-7 


-.3081  -.014  -.005 

-.121  -.1954  -.0064 

-.0692  -.1117  -.1465 


Eo  "  Bo  +  co[-Ei  1D1  '  nI  = 


-1.3526  .2447  .0015 

2.0622  -3.3995  .2319 

0  4-5 


Using  Proposition  (2.4),  we  get  the  following  values  for 


P  .  .  (n)  : 

n ,  m ;  i ,  o 


From  equation  (2.35)  the  expected  probabilities  for 
the  number  of  modules  down  at  the  time  of  attack  become: 

State;  (i,j):  (0,0)  (0,1)  (0,2)  (1,0)  (1,1)  (1,2)  (2,0)  (2,1)  (2,2) 

E[P.  .(W)]  :  .5825  .1269  .0170  .1433  .0491  .0074  .0570  .0147  .0017 

1  '  J 

Hence,  from  equation  (2.36),  the  readiness  is  given  by: 

P{D  (0)  =  0}  =  .0978 

P{ D  (0 )  =  1}  =  .9022 

The  example  was  used  only  to  show  a  simple  applica¬ 
tion  for  the  method  of  computing  the  operational  readiness 
of  the  aircraft-squadron  using  the  matrix  geometric  approach. 

The  results  obtained  were  compared  with  the  results  obtained 
by  writing  down  the  generator  and  solving  for  the  limiting  dis¬ 
tribution,  and  for  the  Laplace  transforms.  The  results  obtained 
were  the  same  as  those  obtained  using  the  matrix  geometric  ap¬ 
proach.  The  matrix  geometric  method  has  the  attractiveness  that 
at  any  time  we  are  working  with  small-size  matrices,  which 
allows  for  solving  a  large-scale  problem.  As  shown  before, 
if  we  are  considering  a  system  with  =  M2  =  m°dules, 

then  the  infinitesimal  generator  will  be  of  size  10,201  x 10,201. 

which  is  too  large  to  calculate  the  limiting  distribution  and 

.  — ►  -►  — ► 

Laplace  transform  by  solving  ttQ  =  0,  ue  =  1  directly.  Using 
the  matrix  geometric  approach,  we  can  only  work  with  matrices 
of  size  101  x 101,  which  are  much  smaller. 
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III.  FORMULATION  AND  ANALYSIS  OF  A  PROBLEM  IN  REPAIRMEN 
ALLOCATION  FOR  AN  OPERATIONAL  LOGISTICS  SYSTEM 

A.  INTRODUCTION 

This  chapter  models  a  repair  shop  maintenance  process  for 
a  given  aircraft  squadron.  The  model  formulation  is  based  on 
a  stochastic  continuous-time  Markovian  decision  process. 
Mathematical  programming  optimization  techniques  are  imple¬ 
mented  to  determine  the  optimal  repair  policy.  After  this  brief 
introduction,  the  objectives  of  this  chapter  will  be  presented, 
followed  by  the  scope  of  work.  The  problem  characteristics 
will  be  introduced,  followed  by  the  assumptions  used  in  the 
model.  The  model  is  then  developed,  and  sample  solution  of 
the  model,  using  dynamic  and  linear  programming  techniques, 
are  analyzed  and  verified.  The  optimization  techniques  are 
compared,  and  potential  opportunities  for  improvements  are 
suggested . 

B.  OBJECTIVE 

The  objective  of  this  chapter  is  to  formulate  and  analyze 
a  repair  policy  for  an  aircraft  squadron.  Analysis  of  the 
repair  policy  means  determining  the  various  repair  policies 
available  to  the  shop  supervisor,  defining  the  effect  of  each 
policy  on  the  squadron  readiness,  and  selecting  that  repair 
policy  which  maximizes  the  expected  number  of  aircraft  ready 
to  engage  or  "scramble"  when  an  attack  occurs. 


C.  SCOPE 

An  air-interceptor  squadron  is  selected  to  represent  the 
operational  situation  under  study.  The  squadron  is  considered 
to  operate  independently  of  other  squadrons.  An  aircraft  re¬ 
quires  a  certain  number  of  its  systems  to  operate  in  order  to 
be  considered  operational.  The  shop  supervisor  is  assigned 
R  repairmen  capable  of  repairing  all  types  of  systems  installed 
on  the  aircraft  (i.e.,  general  technicians). 

This  study  concentrates  on  finding  the  optimal  way  of  dis¬ 
tributing  the  repairmen  among  different  shops.  Here  the  term 
"optimal"  refers  to  the  maximization  of  the  readiness  of  the 
squadron.  Ultimately  the  readiness  of  the  squadron  is  assessed 
by  its  ability  to  engage  into  air  combat  when  called  upon  with 
the  maximum  number  of  interceptors  in  an  attempt  to  minimize 
the  number  of  enemy  bombers  reaching  their  targets. 

D.  APPROACH 

To  achieve  the  above  objectives,  the  repair  process  of 
the  squadron  during  peace-time  or  non-combat  periods  has  to 
be  analyzed.  The  effect  of  the  repairmen  assignment  decisions 
constitutes  the  restrictions  for  determining  the  optimal  repair 
policy.  When  an  aircraft  lands,  the  entire  repair  shop  com¬ 
plex  experiences  simultaneous  demands  for  several  different 
types  of  repair.  It  is  assumed  that  an  aircraft  consists  of 
several  types  of  systems;  for  example,  engine  (propulsion), 
communications,  airframe  systems,  etc.  The  system  is  referred 
to  as  a  module.  Let  the  number  of  modules  of  type  i  down  for 
repair  at  time  t  be  {X.(t),t  •  0}. 


m 


l 


m 


'Wji 

m 


The  vector  whose  components  are  X^(t)  for  all  K  types  of 


modules  installed  on  the  aircraft,  is  taken  to  be  the  state 


of  the  system.  Because  the  probabilistic  nature  of  the 


system  state  changes,  the  process  X(t)  =  {X^ (t) , . . . ,XR(t) ; 


t  _>  0}  represents  a  multivariate  stochastic  process.  It 


will  be  assumed  that  the  state  of  the  system  at  time  (t+s) 


given  the  history  to  time  t  is  a  function  only  of  the  state 


at  t,  so  the  process  can  be  handled  as  a  multivariate- 


continuous-time  Markov  process.  If  the  supervisor  is  able 


to  make  a  decision  on  the  required  number  of  repairmen  to  be 


assigned  to  every  shop,  every  time  the  state  of  the  system 


changes,  then  the  problem  can  be  formulated  as  a  multivariate- 


continuous-time  Markov  decision  process.  Although  it  may  be 


unrealistic  to  assume  that  the  personnel  are  so  rapidly  inter¬ 


changeable,  this  is  the  situation  that  is  examined. 


Consider  a  system,  S,  which  at  any  point  of  time  must 


be  in  exactly  one  of  s  possible  states,  labeled  l,2,...,s 


Suppose  S  operates  from  time  zero  to  time  T,  where  T  ■*  00 . 


When  S  is  in  state  i,  an  action  y  is  chosen  from  a  finite  set 


I\  of  possible  actions,  and  the  return  rate  is  f(i,y)  that 


depends  only  on  the  current  state  and  action  taken. 


The  policy  is  assumed  to  be  a  stationary  policy.  A  policy 


is  said  to  be  stationary  if  it  is  non  randomized  and  the 


decision  it  chooses  at  time  t  depends  only  on  the  state  of 


the  process  at  time  t  (Ross,  1983).  It  follows  that  if  a 


stationary  policy  is  employed  then  the  sequence  of  states 


(X(t),t  >_  0}  forms  a  continuous-time  Markov  process  with  a 
transition  probability, 

P-  ,(t)  =  P.  .  ( t ,  y  ( i )  )  .  (3.1) 

1  /  J  1  >  j 

The  evolution  of  the  system  from  state  to  state  described 

by  P-  .(t,y(i))  depends  on  the  infinitesimal  generator  whose 
1  /  J 

elements  are  q(j  |i,y(i)  )  ,  j  =  1,2, ...  ,M,  where  0<_q(j|i,y(i))  < 

j  ^  i,  is  the  rate  of  transition  from  state  i  to  state  j  when 

M 

decision  y (i)  is  employed,  and  q(i|i,y(i))  =  -  j  q(j |i,y (i) ) . 

i=l 

Therefore  a  collection  of  the  row  vectors  q(j|i,y(i)) 
for  i  =  1 , . . . , M  will  form  an  infinitesimal  generator  that 
uniquely  determines  a  continuous-time  Markov  process.  That  is, 
the  probability  is  q  ( j  |  i,'y  (i) )  dt  +  o(dt)  that  the  system  will 
be  in  state  j  at  time  t+dt,  0  £  dt  <  6 ,  6  >  0,  given  that  it  is 
in  state  i  at  time  t  and  action  y(i)  e  is  always  used  in 
the  interval  [t,t+6)  when  the  system  is  in  state  i. 

The  preceding  statement  can  be  generalized  for  the  multi¬ 
variate-continuous-time  Markov  process.  A  state  can  be  repre¬ 
sented  by  a  vector  whose  components  are  the  states  for  the 
marginal-continuous-time  Markov  process.  Let  m  be  the 
cardinality  of  the  set  of  all  possible  state  vectors;  then 
the  system  can  be  found  in  one  of  m  possible  states  labeled 
l,2,...,m  at  any  point  of  time.  When  the  system  is  in  state 
i  an  action  y(i)  is  chosen  from  a  finite  set  T..  The  dimen- 

l 

— * 

sionality  of  y(i)  need  not  be  the  same  as  the  vector 


representing  state  i.  The  dimensionality  of  y  (i)  depends 
on  the  type  of  actions  considered. 


For  example,  if  {  (X1  (t)  ,X2  (t)  ,X3  (t)  ,X4  (t)  )  , t  >_  0}  repre¬ 
sents  the  number  of  modules  of  types  1,  2,  3  and  4  down, 
respectively,  and  the  action  to  be  determined  is  the  total 
number  of  repairmen  to  be  assigned  to  the  maintenance  facility, 
i.e.,  the  repairmen  are  assumed  to  be  capable  of  repairing 
all  types  of  modules/  then  y(i)  is  a  scalar.  More  realis¬ 
tically,  suppose  that  the  supervisor  is  assigned  R  repairmen, 
and  the  action  to  be  taken  is  to  distribute  the  R  repairmen 
among  the  four  shops.  Then  y(i)  is  °f  dimension  3.  The  first 
component  of  y(i)  will  be  R^ ,  the  number  of  repairmen  to  be 
assigned  to  Shop  1.  The  second  component  is  R2 ,  the  number 
of  repairmen  assigned  to  Shop  2,  and  the  third  is  R^ ,  the 
number  of  repairmen  assigned  to  Shop  3.  R4 ,  the  number  of 
repairmen  assigned  to  Shop  4,  is  the  balance,  R^  =  R-(R1+R2+R3) 
and  need  not  be  a  component  in  the  vector  yd). 

Therefore,  if  a  stationary  policy  is  employed  then  the 
sequence  of  states  {X(t),t  >_  0}  where  X(t)  is  a  vector,  forms 
a  multi-variate  continuous-time  Markov  process  with  a  transi¬ 
tion  probability  P.  . (t)  =  P.  .  (t,y(i)).  As  in  the  univariate 

1  /  3  1  /  3 

case  there  will  be  a  unique  infinitesimal  generator  for  every 
policy  to  be  considered. 


E.  PROBLEM  CHARACTERISTICS 

The  problem  is  characterized  by  these  main  aspects: 

Demand  process. 

Repair  process. 

Repairmen  assignment  decisions. 

1 .  Demand  Process 

The  demand  process  depends  on  factors  that  include 
number  of  aircraft  in  operation,  number  of  pilots  assigned, 
probability  of  failure  of  modules,  possibility  of  a  simul¬ 
taneous  failure,  i.e.,  resulting  in  a  simultaneous  demand. 

2 .  Repair  Process 

The  factors  affecting  the  repair  process  can  be 
categorized  as: 

Factors  related  to  the  maintenance  organization. 

Factors  related  to  the  operational  organization. 

Other  factors. 

Maintenance  organizational  factors  include  the  number 
in  various  skill  categories  of  repairmen,  the  location  of 
different  shops,  rate  of  repair,  availability  of  tools  and 
test  instruments,  and  the  cannibalization  policy. 

Operational  factors  include  number  of  aircraft  assigned 
to  the  squadron,  type  of  missions  the  aircraft  are  conducting, 
pilot  skills  and  training,  failure  rate  of  the  modules  in¬ 
stalled,  and  the  sortie  frequency. 

Other  factors  include  weather  conditions,  foreign 


object  damage  (FOD) ,  manufacture  or  urgent  maintenance  bulletins 
changes  in  type  of  threat,  and  number  of  spares  available. 


The  two  major  factors  affecting  the  repair  policy 


are  the  failure  rate  and  the  repair  rate  of  each  type.  The 
failure  rate  of  each  type  of  module  depends  on  the  number  of 
aircraft,  the  failure  rate  of  a  module,  the  conditional  proba¬ 
bility  of  the  module  failing  given  an' aircraft  reported  failed, 
and  the  total  number  of  spare  modules  available. 

The  repair  rate  of  each  type  is  a  function  of  the 
repair  rate  of  a  single  repairman  or  team,  the  number  of 
repairmen  assigned,  and  the  number  of  modules  of  the  same 
type  down  at  a  given  time. 

These  two  major  factors  will  be  considered  in  analyzing 
the  repair  policy  in  this  chapter. 

3 .  Repairmen  Assignment  Decisions 

The  repairmen  assignment  decisions  are  the  responsi¬ 
bility  of  the  maintenance  commander  (supervisor) .  The  decision 
concerning  the  number  of  repairmen  to  be  assigned  to  each 
repair  shop  when  the  state  of  the  system  changes  should  follow 
a  (nearly)  optimal  repairman  assignment  policy;  such  a  policy 
is  referred  to  in  this  study  as  the  repair  policy.  The  factors 
affecting  the  repair  policy  can  be  classified  as: 

dependent  upon  the  logistics  system  of  the  squadron,  or 
dependent  upon  the  repair  process. 

The  logistics  system  factors  include  the  availability 
of  maintenance  tools,  documentation,  preventive  maintenance 
program,  spare  parts  when  needed,  quality  assurance  program, 
and  many  others.  In  what  follows  the  influence  of  such  factors 
will  be  left  implicit. 
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The  repair  process  factors  include  repair  time  (diag¬ 


nostic,  removal  of  module  from  aircraft,  ordering  parts, 
repair  of  a  failed  module,  testing  of  a  module  after  repair, 
quality  assurance  inspection) ,  and  the  queueing  discipline 
used  in  the  shop.  For  example , first-come-f irst-serve ,  or  a 
priority  system  may  be  employed. 

The  major  factors  affecting  the  assignment  decisions 
are  the  number  of  modules  down  requiring  repair  of  each  type, 
and  the  number  of  repairmen  assigned  to  the  maintenance  organi¬ 
zation.  Therefore,  the  maintenance  commander  has  to  choose 
one  decision  among  a  finite  set  of  possible  decisions  while 
considering  the  combat  effectiveness  of  the  squadron.  The 
combat  effectiveness  of  the  squadron  during  peace  time  (be¬ 
tween  combat  occasions)  can  be  assumed  to  represent  the  readiness 
of  the  squadron  at  any  point  in  time,  which  can  be  represented 
by  the  expected  number  of  aircraft  ready  (or  up)  to  engage  in 
combat  at  the  time  the  squadron  must  respond  to  an  attack. 

This  chapter  presents  a  mathematical  model  that  will 
identify  an  optimal  repair  policy  among  finite  feasible  poli¬ 
cies  that  are  available  for  the  commander  to  follow.  As  will 
be  seen,  the  policy  is  idealized  so  as  to  allow  calculations 
to  be  made.  It  does  not  recognize  all  reasonable  constraints 
to  which  the  repair  system  is  subject.  Nevertheless  it,  or 
its  extensions,  should  provide  some  useful  guidance  for  a 
decision  maker. 


F.  PROBLEM  FORMULATION 


Consider  an  aircraft  squadron  that  consists  of  a  number, 
a,  of  failure-prone  aircraft  each  susceptible  to  failure  from 
one  or  both  of  two  causes.  Let  X  denote  the  overall  Markovian 
failure  rate  of  an  individual  aircraft,  and  let  denote  the 
conditional  probability  that  a  failure  requires  just  Type  1 
(e.g.,  engine)  repair,  P2  the  conditional  probability  that  the 
failure  is  of  Type  2  {e.g.,  communications)  and  P^2  the  condi¬ 
tional  probability  that  both  Type-1  and  Type -2  failures  occur. 
Thus,  +  p2  +  P12  =  '  an<^  the  sequence  of  successive  failure 

types  is  one  of  independently  and  identically  distributed 
random  variables.  Suppose  that  there  are  M^  and  M2  modules  of 
Type  1  and  Type  2  respectively,  assigned  to  the  squadron  where 
min{M^,M2>  >_  a.  There  are  R  repairmen  assigned  to  the  squadron 
where  each  repairman  is  capable  of  repairing  both  types  of 
modules . 

Next,  let  X^(t),  i  =  1,2,  denote  the  number  of  modules 
of  Type  i,  i  =  1,2,  that  are  in  or  require  repair  at  time  t. 
Thus  the  number  of  operational  aircraft  is  min{a,M^-X^ (t) , 

M2-X2  (t) }  where  it  is  assumed  that  an  aircraft  requires  both 
modules  (one  of  each)  to  be  considered  operational,  and  this 
is  the  number  of  aircraft  that  are  failure-prone;  the  others 
are  awaiting  one  or  both  of  the  Type -1  and/or  Type-2  modules. 
Finally,  it  is  assumed  that  repair  is  Markovian  (or  exponen¬ 
tial):  denotes  the  rate  at  which  an  individual  repair 

of  Type  i,  i  =  1,2,  is  completed  at  Shop  i. 
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If  Shop  1,  where  repair  of  Type  1  module  is  conducted, 
has  R^  repairmen  assigned,  where  0  _<  £  R,  then  the  transi¬ 

tion  probabilities  are,  to  terms  of  order  dt: 


t 

t+dt 

Probability 

(i,  j) 

-> 

(i+1 , j ) 

P1  A 

min{a ,M^-i ,M2~ j }dt 

(i , j+1) 

P2  A 

min {a ,M^-i ,M2~ j }dt 

-> 

(i+1, j+1) 

P12X 

min{a  jM^-i ,M2~ j }dt 

-> 

(i-1  /  j ) 

»*1 

min{R^ , i}dt 

-V 

(i,j-l) 

y2 

min{R-R1 , j }dt 

The  above  assumptions  and  formulation  specify  the  sto¬ 
chastic  process  {X^ (t) ,X2 (t) , t  >_  0}  as  a  bivariate  Markov 
birth-and-death  process.  The  limiting  probability  exists 
and  can  be  found  by  solving  a  system  of  linear  equations. 

G.  DECISION  MODEL  FORMULATION:  A  REPAIR  POLICY 

A  repair  policy  is  a  rule  for  making  decisions  after 
observing  the  system.  The  policies  that  are  considered  in 
this  study  are  the  type  of  policies  that  depend  only  upon  the 
observed  state  of  the  system  at  time  t,  {X^ (t) ,X2 (t) } ,  and 
the  possible  decisions  available,  where  decisions  can  only 
be  taken  when  the  state  of  the  system  changes.  Therefore 
each  policy  can  be  completely  characterized  by  a  vector  that 
prescribes  the  decision  to  be  taken  when  the  system  is  in 
state  (i,j),  i  =  0,1,..., M^;  j  =  0,1,..., M2 .  The  components 
of  such  a  vector  represent  the  number  of  repairmen  to  be 
assigned  to  Shop  Type  1  when  the  system  is  in  state  (i,j). 


115 


My, 

V,'l 

'?  7 


v, 


ya 


si 

ia 


**»;**] 

I 


m 


% 


i 


1 


ii 


i 


I 


1 


& 

I 

v'! 


All  policies  to  be  considered  are  stationary  policies.  That 


is, whenever  the  process  is  in  state  (i,j),  the  decision  to 


be  made  is  the  same  for  all  values  of  t. 


The  objective  of  the  maintenance  commander  is  to  maximize 


the  squadron  readiness,  which  will  be  measured,  as  stated 


before,  by  the  expected  number  of  operational  aircraft. 


Alternative  measures  are  possible,  and  may  even  be  more  appro¬ 


priate.  To  obtain  a  mathematical  expression  for  the  commander' 


objective,  define  the  following: 


Pnm  ij  (t)  =  p{Xi(t)  =  i,X2(t)  =  j | X1 (0)  =  n,X2(0)  =  m}  (3.3) 


P-^  (t)  =  P  ..(t),  then 
l j  nm , l 3 


(3.4) 


=  lim  P . . ( t ) 


(3.5) 


i.e.,  ir.  .is  the  limiting  probability  of  observing  the 
1  >  3 


system  to  be  in  state  (i,j) 


All  states  of  the  Markov  process  defined  by  (3.2)  com¬ 


municate,  so  the  Markov  process  is  irreducible.  Hence  the 


limiting  distribution  exists  and  is  independent  of  the  initial 


condition.  Since  every  state  is  a  positive  recurrent 


state,  the  limiting  probabilities  ik  are  all  positive 

and  form  a  probability  distribution;  (i.e.,  it.  >0). 

1 , 3 


Let  S  be  the  collection  of  all  possible  states  for  the 


process  {X^  (t)  ,X2  (t)  ;  t  0}. 

S  =  {  ( i , j )  ;  i  =  0,l,...,M^;j  =  0,1,..., M2}  . 

The  cardinality  of  the  set  S  is  (M^+l)  (l^  +  l).  When  the  process 
is  in  state  (i,j),  there  are  f(i,j)  =  min{a ,M^-i ,M2~ j } 
operational  aircraft.  Therefore  the  commander's  objective 
stated  mathematically  is: 

max  l  f  ( i ,  j  )  it .  . 

all  y  (i ,  j  )  (i  ,  j  )  <:S 

where  y(i»j)  is  the  action  taken  whenever  the  process  is  in 
state  (i , j ) . 

To  compute  the  optimal  repair  policy,  two  optimization 
approaches  will  be  used,  linear  programming  and  dynamic 
programming . 

To  simplify  the  notation,  it  may  be  observed  that  a 
one-to-one  mapping  between  the  set  N  =  { 1 , 2 , . . . , (M^+l ) (M^+l ) } 
and  the  set  S  can  be  defined.  Figure  (3.1)  shows  a  corres¬ 
pondence  between  N  and  S.  Let  n  ►  N ,  and  (i,j)  t  S.  We 
need  to  determine  the  values  of  i  and  j  if  n  is  known.  We 
note  that, 

if  n  £  M2  +  l  th611  i  =  0 
and  if  M2  +  l  <  n  —  2(M2+1)  then  i  =  1 

117 


Hence,  if  n^(M2  +  l)  <  n  £  (n^+1) (M2+l)  then  i  =  n^ 


The  general  form  is 


i(M2+l)  <  n  £  {i+-l)(M2+l) 


Therefore,  if  n  is  known,  then  i  must  satisfy: 


n  ,  n 

M2+l-i  -  1  M2+1 


Note  that  i  must  be  integer.  Therefore:  if 


M— Tl  is  inte9er'  then  i  =  gj-+T 


Suppose  that  - — ^  is  not  integer,  then; 


n  ^  ^  iL 

M2+l“  -  1  -  M2+l 


where  pf|  is  defined  to  the  smallest  integer  >_  X,  and  [_Xj 
the  largest  integer  <  X.  But, 


m2  +1 


M2  +1 


-1  = 


M2  +1 


Therefore , 


•  11  1 
1  ~  m2  +1  ~  1 


(3.6) 


n  =  i (M-+1 )  +  j  +  1 


j  =  n-i(M.,+l)  -  1 


(3.8) 


To  illustrate  the  above,  consider  the  case  where  =  2 
and  M2  =  3 .  A  graph  of  the  state  space  is  shown  in  Figure 
(3.1),  where  each  state  is  numbered  by  n  and  the  corresponding 
(i,j)  values.  Table  (3.1)  shows  the  correspondence  between 
n  and  (i,j)  computed  using  equations  (3.6)  and  (3.8).  Examina 
tion  of  the  table  shows  clearly  the  usefulness  of  equations 
(3.6)  and  (3.8). 


(0,0 


(1,0) 


(0,2) 


(1,2) 


(2,0: 


Figure  3.1.  A  Correspondence  Between  n  and  { 1 , j ) 


To  generalize  the  above  mapping,  we  derive  equations 
similar  to  equations  (3.6)  and  (3.8)  for  the  case  of  a 
trivariate-continuous-time  Markov  process. 

Consider  a  Markov  process  X(t)  { ( t ) , ( t ) , ( t ) ; t 
operating  on  a  state  space  S  =  '  (  i  ,  j  ,  k )  :  i  =  0  ,  .  .  .  ,M  ■>  , 


mmsmm 


TABLE  3.1 


THE  CORRESPONDENCE  BETWEEN  N  AND  (I,J) 
USING  EQUATIONS  (3.6)  AND  (3.8) 


l  = 


n 


m2  +1 


-  1 


D  =  n  - 


0 

0 

0 

0 

1 

1 

1 


2 

2 

2 

2 


..,M2;k  =  0  ,  .  .  .  , M3  }  .  Let  N  =  { 1 , 2  ,  .  .  .  ,  (N^  +  l 
N,  then  we  need  to  determine  (i,j,k). 


n  £  (M2  +  l)  ( M ^  + 1 )  then  i  = 

(M2+l) (M3+l)  <  n  £  2 (M2+l) (M3+l)  then  i  = 


(M-  +  1)  (M,+l )  <  n 


(n, +1 ) (M-+1 ) (M,+l )  then 


Therefore,  if  n  is  known,  then  i  must  satisfy: 


n  ,  n 

(M2+l) (M3+l)  -  1  <  (M2+l) (M3+I) 


Using  the  same  argument  used  for  the  bivariate  case  we 


find  that: 


(M2+l) (M3+l) 


Now,  knowing  both  i  and  n,  we  need  to  determine  j. 
If  i  =  0,  then: 


n  _<  (M^+l) 


then  j  =  0 


(M^+l)  <  n  £  2(M3+1)  then  j  =  1 


If  n2 (M^+l )  <  n  £  (n2+l) (M3+l)  then  j  =  n. 


Hence:  If  i  =  0  then  j  = 


If  i  =  1,  then: 


(M3+l) 


If  (M2  +  l)  (M3+I)  <  n  1  [  (M2+l) +1]  (M-j+l)  then  j  =  0 

If  [ (M2+l ) +n2 1 (M^+l)  <  n  ^  [ (M2+l ) +n2+l ] (M^+l)  then  j  =  n2 


Hence:  If  i  =  1,  then  j  = 


spr  -  'V1'  -  1 


Therefore 


]  M3+l  i(M2+1)  1 


; 
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=  i  (M2+1)  (M3+l)  +  j(M3+l)  +  k  +  1 


Thus,  the  trivariate  Markov  process  X(t),  operating  on 
the  state  space  S,  can  be  transformed  into  the  univariate 
Markov  process  {y(t),t  0}  operating  on  the  state  space  N 

by  using  the  following  equations: 


n  =  i (M2+l) (M^+1)  +  j(M3+l)  +  k  +  1 


(M2+l) (M3+l) 


3  =  M^I  ~  i(M2+1)  -  1 


=  n  -  i (M2+l) (M3+l)  -  j(M3+l)  -  1 


Various  trial  runs  have  been  conducted  on  the  above 
equations  for  both  bivariate  and  trivariate  Markov  processes 
and  found  to  be  correct.  This  shows  that  a  generalization 
for  a  variate-Markov  process  is  possible,  as  shown  below 

Consider  a  K  -var iate-continuous-time-Markov  process 
X  ( t )  =  {X-i  (t)  ,  X9  (t ),..., X  { t)  ;  t  >  0}  operating  on  the  state 


space  S  =  {  (i.  ,  i_  ,  .  .  .  ,  i.  )  ;  i  .  =  0,...,M.  ,  j  =  1,...,K}.  The 

1  *  K  1  k  ^ 

cardinality  of  the  state  space  is  IT  (M.+l). 


Let  N  =  {1,2,...,  n  (M.+l)}.  Let  n  <  N.  Then: 


K-l  K 

n  =  y  i.  il  (M„+l)  +  i„  +  1 


n  (M.+i) 
j=2  3 


n  (M.+i) 
j=m+l  ^ 


m-1  m 

l  ip  n  (M.+l)-l 
£  =  1  *  j=£+l  J 


(3.9) 


2  <  m  <  K-l 


K-l  K 

iK  =  n  -  I  i-i  n  (M  +1)  -  1 

j=l  3  1=2+1 


Considering  different  values  for  K,  we  get  the  following 
equations : 


For  K  =  2 : 


n  =  i1 (M2+l)  +  i2  +  1 


(M2+l) 


i2  =  n  -  i1(M2+l)  -  1 


For  K  =  3: 


n  =  i^(M2+l) (M^+l)  +  i2 (M^  +  l )  +  i^  +  1 


l,  - 
i 


(M2+l) (M3+l) 


X2 


(K3+l)  11(H2+1)  1 


V,V, 


i2 (M3+l)  -  1 
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i3  =  n  -  (M2+l)  (M3+l) 


For  K  =  4 : 


n  =  i1 (M2+l)  (M3+l)  (M4+l)  +  i2  (M3+l)  (M4+l)  +  i3 (M4  +  l)  +  i4+l 


(M2+l) (M3+l) (M4+l) 


(M3+l) (M4+l)  "  11(M2+1)  "  1 


(M4+l)  ~  ^1  (M2+1^M3+1^  “  i2^M3+1^  "  1 


i4  =  n  -  i1(M2+l) (M3+l) (M4+l)  -  i2 (M3+l) (M4+l) 


i3(M4+l)  -  1 


For  K  =  5: 


n  =  i1(M2+D  (M3+l)  (M4+l)  (M5+l)  +  i2  (M3+l)  (M4+l)  (M5+l) 


+  i3(M4+l) (M5+l)  +  i4(M5+l)  +  i5  +  1 


(M2+l) (M3+l) (M4+l) (M5+l) 


(M3+l) (M4+l) (M5+l)  "  11(M2+1)  ■  1 


(M4  +  l)  (M5+l)  !]_  (M2  +  l)  (M3+l)  -  12(M3  +  1)  -  1 


55! 

•5? 

mm 

mmmwm 


14  =  TiipTJ  -  ii^+l)  (M3+l)  (M4+l)-i2(M3+l)  (M4+l)-i3(M4+l)-l 

15  =  n-ii(M2+1) (M3+1) (M4+1)  <M5+1)_i2 (M3+1) (M4+1) (M5+1) 

-  i3(M4+l) (m5+1)  -  i4(M5+l)  -  1 

Various  examples  carried  out  for  the  various  cases  and 
the  above  equations  were  found  to  give  the  correct  corres¬ 
pondence  between  the  set  N  and  the  corresponding  state  space 
S. 

Therefore,  it  could  be  concluded  that  the  set  of  equations 

(3.9)  allow  us  to  transform  a  K-dimensional-continuous-time 

Markov  process  operating  on  a  finite  discrete  state  space 

to  a  univariate-continuous-time  Markov  process  operating  on 

K 

the  finite  state  space  N  =  {1,2,...,  n  (M.+l)}.  This  allows 

j-i  3 

the  analyst  to  carry  out  all  necessary  analysis  on  the  uni- 
variate-continuous-time-Markov  process,  using  all  existing 
theorems  and  algorithms  for  the  univariate  process,  and 
then  retransforming  the  results  back  to  the  K-dimensional 
process  using  again  the  set  of  equations  (3.9). 

As  shown  above,  in  the  case  of  bivariate  Markov  process, 
knowing  n,  the  corresponding  state  (i,j)  can  be  determined 
and  vice  versa,  i.e.,  if  (i,j)  is  known,  then  n  can  be 
determined.  With  such  observations  the  bivariate  continuous- 
time-Markov-process  can  be  transformed  into  a  univariate- 
continuous-time-Markov-process .  Define  the  stochastic 
process  {Y(t),t  21  0}  to  be  a  continuous-time-Markov  process 
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operating  on  the  state  space  { 1 , 2  ,  .  .  .  ,  (M.^  +  1 )  (M2+l )  }  .  Hence, 

if  Y (t)  =  n  then  X^(t)  =  i,  X2  (t)  =  j  where  i,j  are  given 

by  equations  (3.6)  and  (3.8)  respectively. 

Let  P  (t)  =  P { Y ( t )  =  n  j  Y  (  0)  =  m} 
m,  n  1 

Pm,n (t)  =  p{xl(t)  =  i'X2(t>  =  3|X1(0)  =  iQ,X2(0)  =  jQ; 


where ; 


M2  +  l 


jo  =  m  -  iQ(M2  +  l)  -  1 


i,j  are  given  by  Equations  (3.6)  and  (3.8) 


Let  it  =  lim  P  (t) 

n  t+oo  m'n 


=  lim  P{Xx(t)  =  i,X2(t)  =  j|X1(0)  =  iorX2(0)  =  jQ) 
t*>00 


Using  equations  (3.3)  to  (3.5),  the  following  was  obtained: 


IT  =  TF  . 

n  i,3 


Since  tt  .  .  was  shown  to  exist  and  is  positive,  therefore 
it  was  concluded  that  tr  will  exist  and  is  strictly  positive 
(i.e.,  0  <  tt  <  1). 


A  be  the  total  failure  rate  when  the  process  is  in 
state  n. 


be  the  total  repair  rate  when  the  process  is 
in  state  n  for  Shop  1 . 


U 2n  be  the  total  repair  rate  when  the  process  is 
in  state  n  for  Shop  2 . 


Therefore : 


An  =  A  f (n) 

uln  =  yl  min 

u2n  =  y2  min  (R~Y  '3 > 

where : 


f  (n)  =  min{a ,M1~i ,M2~ j } 

i  and  j  are  given  by  equations  (3.6)  and  (3.8). 

Figure  (3.2)  shows  the  corresponding  transition  graph 
for  the  process  {Y(t),t  >_  0}.  The  transition  for  any  state 
(i,j)  is  shown  in  Figure  (3.3)  for  any  repair  policy. 

H.  LINEAR  PROGRAMMING  APPROACH 

Let  tt^  ^(7)  be  the  unconditional  limiting  probability  that 
the  system  is  in  state  (i,j)  and  decision  7  is  made,  that 
is : 


TT  . 

i/D 


(Y  ) 


Pistate  =  (i,j)  and  decision  =  7}  , 
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Figure  3.2.  Transition  Flow  for  the 
Failure-Repair  Process 


7K5 


Figure  3.3.  The  Transitions  Flow  for  State  (i,j 
for  any  Repair  Policy 
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b  l  V\  IL1  l 


Therefore 


IT 

n 


(Y> 


(3.10) 


where : 


tt  n  ( Y )  =  P{  state  =  n  and  decision  =  y}  . 

These  limiting  probabilities  were  obtained  from  equations 
(3.6)  and  (3.8). 

From  the  law  of  total  probability,  we  get: 

P{state  =  (i,j)}  =  l  P{state  =  (i,j)  and  decision  =  y} 

Y 

"n  =  l  1Tn(y)  (3.11) 

Y 

Since  tt  is  a  limitinq  distribution,  then  tt  is  the 
n  J  n 

unique  solution  for  the  following  system  of  linear  equations: 
(Mj+1) (M2+l) 

1‘  I  71  n  =  1 

n=l  n 

(M1+l) (M2+l) 

2.  Y  tf  q(n,m)  =  0  m=l,2,...,(M1+l)(M0  +  l) 

n=l  n  1  1 

(the  forward  equations) 


element  of  the  matrix  Q,  the 


where:  q(n,m)  is  the  (n,m) 

infinitesimal  generator  of  the  Markov  Process;  i.e.,  q(n,m) 
is  thought  of  as  the  rate  from  state  n  to  state  m.  Therefore 
tt  n  ( y )  must  satisfy  the  following  linear  relations: 


(M1+l ) (m2+i: 


l  %<Y) 
Y  0 


(M1+1) (M2+1)  r 


l  7T  (Y)qv(n,m) 

■v =o  n  Y 


0  m  =  1 , 2 , . . . , (M^+l ) (M2+l ] 


3.  "n^Y)  -  0  Y  =  0,1,2,.  ..,R  n  =  1,0,2,  ...,  (Mx+1)  (M2+l) 


The  long  run  expected  number  of  aircraft  that  are  opera¬ 


tional  is  given  by: 


E [Number  of  aircraft  operational]  = 


(Mj+1) (M  +1) 

l  f  ( n )  7T 


(M1+1)(M2+1)  r 


l  f  (n)nn(Y 
Y=0 


Therefore  the  objective  function  is  given  by: 


(M1+l) (M2+l)  r 

maximize  £  l  f(n)TT  (,) 

n=l  y=0 


‘  “  "_V  \a  *  a  "  ji  >  v»  *  «V  w  *  m  •.  L  r  Aw  f  A.  “  *  •  A  »  •  »  *  *  »  u  * 


h r 


TT 


y.  This  observation  (Ross,  1983),  allows  us  to  solve  the 
linear  program,  and  the  solution  will  always  have  y  as  either 
0  or  1 . 

The  above  formulated  linear  programming  problem  has 
(M^+l) (M2+l)+l  =  M^M2  +  +  2  functional  constraints. 

Since  the  infinitesimal  generator  Q  is  of  rank  M]_M2+^l+^2+^ ' 
there  is  a  constraint  that  is  linearly  dependent  on  the  other 
constraints.  Hence  the  problem  has  a  single  redundant  con¬ 
straint,  and  the  number  of  constraints  in  the  L-P  can  be 
reduced  at  no  loss  by  dropping  one  of  the  constraints  (ii) 
in  the  L-P. 

The  L-P  can  be  solved  by  the  simplex  method,  and  its  solu¬ 
tion  has  some  interesting  properties  (Ross,  1983).  The  solution 
will  contain  (M1+l) (M2+l)  =  M1M2+M^+M2+1  basic  variables 
n  (y)  0.  Since  the  repair  policy  was  assumed  to  be  sta¬ 

tionary,  the  policy  is  deterministic ,  meaning  that  one  and 
only  one  decision  will  be  chosen  each  time  the  process  enters 
any  given  state.  It  follows  that  only  one  rr  ( y * )  >  0,  while 
the  7T  n  ( y )  =  0  for  y  =  0,1,..., R,  y  ^  y*.  Since  the  Markov 
process  is  irreducible  and  since  every  state  is  positive 
recurrent,  it  follows  that  it  (y*)  >  0  for  n  =  1 , 2 ,  .  .  .  ,  (M^  +  l)  (M2  +  I )  . 
Therefore,  1Tn(Y)  >  0  for  exactly  one  y  =  0,1,...,  R,  for  each 
n  =  1 , 2  ,  .  .  .  ,  (M^  +  l )  (M2+I )  . 

The  L-P  has  (R+l) (M^+l) (M2+D  decision  variables.  Suppose 
that  the  problem  at  hand  has  M^  =  50,  M2  =  60,  R  =  20.  Then: 

Number  of  decision  variables  =  (21) (51) (61)  =  65,331  variables. 
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Number  of  constraints 


3112  constraints. 


A 


Therefore  the  'practical'  problems  tend  to  be  large 
under  this  formulation. 


I.  DYNAMIC  PROGRAMMING  APPROACH 

The  f inite-state-cont inuous-time-Markov  process  being 
analyzed  has  been  shown  to  have  a  limiting  distribution. 
Therefore,  the  policy-iteration  method  for  the  solution  of 
the  sequential  decision  process,  developed  by  R.  Howard 
(Howard,  1969),  can  be  used. 

Howard  states  that  every  completely  ergodic  Markov  process 
with  rewards  will  have  a  gain,  g,  given  by: 


N 


9  =  I  Ttnh(n) 

n=l 


(3.12) 


where : 


N  =  number  of  states 


tt  =  limiting  probability  of  being  in  state  n 


h(n)  =  expected  immediate  return  in  state  n  defined 
by: 


h  (n) 


r(n,n)  +  £  q(n,m)r(n,m) 

m^n 

n  =  1 , 2  ,  .  .  .  ,  N 


:3.i3: 


where : 
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q In, m) 


rate  of  transition  from  state  n  to 
state  m. 


r(n,m)  =  reward  associated  with  the  transition 
from  n  to  m. 

Since  there  is  no  reward  gained  by  transitioning  from 
state  n  to  state  m,  r(n,m)  =  0  for  n  ^  m,  and  h(n)  =  r(n,n). 
Hence,  for  the  repair  scheduling  problem: 

(M1+l) (M2+l) 

g  =  l  r  f (n)  (3.14) 

n=l 


where : 


f  (n) 


min(a,M1~ 


n 


m2+i 


-1 


, M~-n  + 


n 


m2+i 


-1 


(M2+l)+l) 


Since  at  each  state  a  decision  has  to  be  chosen  from  a 
number  of  decisions,  therefore  it  can  be  thought  of  as  having 
several  Markov  processes,  and  the  objective  is  to  know  which 
one  yields  the  highest  expected  number  of  aircraft  operational, 
in  the  long  run. 

It  is  possible  to  describe  the  policy  by  a  decision  vector 

F  whose  elements  represent  the  number  of  the  decision  selected 

t  h 

in  each  state;  i.e.,  the  i  element  of  the  vector  T  indicates 
the  number  of  repairmen  to  be  assigned  to  Shop  1  whenever 
the  process  is  in  state  i. 

An  optimal  policy  is  defined  to  be  the  policy  that  maxi¬ 
mizes  the  gain,  or  average  return  per  transition. 


The  optimal  policy  can  be  found  using  the  policy-iteration 
method  which  consists  of  the  value-determination  operation  and 


the  policy- improvement  operation.  Both  operations  can  be 
used  recursively  as  shown  in  Figure  (3.4),  until  the  optimal 
policy  is  found. 

Let : 


V  (t)  =  Total  expected  reward  the  system  will 

1  earn  in  a  time  t  if  it  starts  in  state 

n . 


Vn(t+dt)  can  be  related  to  V  (t)  by  considering  the 
following  transitions  and  rewards. 

t  t+dt  reward 

n  n  f(n)dt+Vn(t) 

(m^n)  Vm(t} 

Therefore , 

Vn(t+dt)  =  (1  -  l  q  (n,m)dt)  [f  (n)dt  +Vn  (t)  ] 

n^m 

+  7  q  (n,m)dtV  (t)  +  o(dt) 

m 

n^m 

But, 


probability 

1  -  l  q(n,m)dt 
n^m 

q(n,m)dt  Vm^n 


q  (n ,  n )  =  -  l  q(n,m) 

n^m 
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MBS 


READ:  f(n)  (No.  aircraft  ready  when 

in  n) 


q  (i,j)  (infinitesimal  rates) 


For  each  state  n  determine  a  decision 


d^  that  maximizes  f(n) 


Set  all  relative  values  Vn  =  0 


POLICY  IMPROVEMENT:  For  each  state  n  find  the 
decision  y*(n)  that  maximizes: 


(M^l)  (M2+l) 


f  (n)  + 


l  q  (n,m)  Vm 

m=l  ' 


Using  the  relative  values  VR  of  the  previous  policy 


Set:  q (n,m)  =  q^ (n,m) 


V(Ml+1) (M2+l)  0 


VALUE  DETERMINATION:  Solve  for  all  remaining 
(M^+l ) (M2+I ) -1  relative  values  Vn  and  the  gain 
of  the  system  (g)  by  solving: 


(Mj+1)  (M2+l) 


g  =  f (n)  + 


a  (n,m)  V 


If  the  policies  on  2  successive 
iterations  are  identical,  stop. 


Figure  3.4.  Iteration  Cycle  Schematic  (Howard,  1969) 
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Vn(t+dt)  =  (1+q (n,n; dt) [f (n)dt+Vn (t) ] 


+  7  q(n,m)dtV  (t)  +  o(dt) 

n^m  m 


Subtracting  Vn(t)  from  both  sides  and  dividing  by  dt,  the 


above  equation  becomes : 


Vn(t+dt)-Vn(t) 


f  (n)  +  q(n,n)f(n)dt  +  q(n,n)V  (t) 


+  l  q  ( n ,  m )  V  ( t ) 
n^m  m 


Let  dt  ->  0 ;  the  above  equation  becomes: 


(M1+l) (M2+l) 


at  Vn(t>  *  f<n)  + 


q  (n,m)  Vm  (t) 


n  =  1,  .  ,  (M-l+1)  (M2+l) 


Changing  to  vector  notation,  this  becomes: 


where : 


V(t)  =  F  +  Q  V(t) 


V  (t)  -  [vx (t) , . . . ,v(  i) (  i) (t) ] 


F  =  [f  (1) . f  (M1  +  l )  (M2+l)] 


Q  =  infinitesimal  generator. 


wmmi  l 


(3.15) 


(3.16) 


The  set  of  equations  (3.16)  is  a  matrix  representation 
of  equations  (3.15).  The  equations  are  a  set  of  linear, 
constant-coefficient  differential  equations  that  relate  the 
total  reward  in  time  t  from  a  start  in  state  n  to  the  quanti¬ 
ties  f (n)  and  q(n,m).  But  for  large  t  (Howard,  1969) 


Vn(t)  =  tgn  +  Vn  n  =  1,..., (Mj+1) (M2+l) 


Therefore : 


dvn(t) 


Using  equation  (3.15)  we  obtain: 


(Mx+1) (M2+l) 


=  f  (n )  + 


q(n,m) (tgm+Vm) 


(M1+l) (M2+l) 


(M1+l) (m2+1) 


=  f  (n)  +  t 


l  g(n,m)gm  + 
m=l 


g  (n,m)  V 


(3.17) 


For  equation  (3.17)  to  hold  for  all  large  t,  we  must  have: 


(Mj+1) (M2+l) 


q  (n  ,m)  g  =  0 


(3.18) 


(m1+d  (m2+i: 


g  (n)  =  f  (n) 


q  (n ,m) V 


(3.19) 


The  set  of  equations  (3.19)  consists  of  (M1+1)(M2+1)  equations 

with  (M^  +  l)  (M2+l)  +1  unknowns  (  (M1+l )  (M2+l ) Vm ' s  and  1  g). 

Therefore  set  V/M  ...  ...  , .  .  =  0  and  solve  for  the  rest. 

(M^+l ) (M2+l) 

Thus,  for  a  given  policy  we  can  find  the  gain  and  the 
relative  values  of  that  policy  by  solving  the  (M^+l) (M2+l) 
linear  equations  simultaneously  with  V ^  ^  =  0. 

The  Policy- Improvement  routine  is  then  used  to  find  a 
policy  that  has  higher  gain  than  the  original  policy. 


(Mj+1)  (M2  +  l) 


Max  f(n)  + 


Vn'B)Vm 


The  optimal  y  will  be  the  decision  to  be  taken  when  in 
state  n;  hence,  a  new  policy  has  been  developed.  The  proce¬ 
dure  is  then  repeated  until  g  is  maximized,  i.e.,  when  the 
policies  on  2  successive  iterations  are  identical. 


MODEL  ILLUSTRATION 

The  following  basic  data  were  used  as  an  example: 

An  aircraft  requires  2  types  of  modules  (e.g.,  engines 
and  communications)  to  be  operational.  Modules  of  Type 
1  are  engines  and  modules  of  Type  2  are  communications 
equipment . 

The  squadron  is  assigned  exactly  2  aircraft. 


The  total  number  of  Type  1  and  Type  2  modules  available 
in  the  squadron  are  2  and  3,  respectively  (i.e., 

M1  =  2'  M2  =  3) 

The  maintenance  commander  is  assigned  3  repairmen, 
and  every  repairman  is  capable  of  repairing  both 
modules . 

An  aircraft  is  reported  down  with  a  rate  X  =  1  aircraft 
per  day. 

The  probabilities  of  an  aircraft  down  due  to  module 
failures  of  Type  1,  Type  2  or  both  Types  are  =  .4, 

=  .5,  P^2  =  -1  respectively.  1 

Modules  of  Type  1  and  Type  2  are  repaired  with  rates 
=  .5  and  =  1  modules  per  day. 

A  FORTRAN  program  has  been  written  to  compute  the  infini¬ 
tesimal  generator  matrices,  and  create  the  output  format 
suitable  for  optimality  analysis.  The  linear  programming 
was  implemented  using  the  LINDO  interactive  package.  A 
FORTRAN  program  to  implement  the  dynamic  programming  approach 
was  written  using  the  policy  improvement  technique.  Appendix  C 
presents  the  computer  listings  for  the  programs. 

The  graph  of  the  above  system  is  shown  in  Figure  (3.5) 
where  the  repair  rates  are  functions  of  the  decision.  The 
infinitesimal  generators  for  y  =  0,1, 2, 3  are  illustrated 
in  Figures  (3.6),  (3.7),  (3.8)  and  (3.9)  respectively.  The 

infinitesimal  generators  Q  for  any  policy  can  now  be  calcu¬ 
lated  using  the  infinitesimal  generators  Q^,  y  =  0,1, 2, 3. 

This  is  done  by  picking  the  necessary  rows  from  the  four  Q 

i 

matrices.  For  example,  suppose  the  infinitesimal  generator 
for  the  policy 


r  =  (1  2  2  0  3  2  1  0  2  2  2  2)  =  (y  (n) 


Figure  3.5.  An  Illustration  of  Transition  Flow  as  a  Function 
of  Decision  Taken  at  Each  State 


Figure  3.6.  The  Infinitesimal  Generator  for  the  Repair  Process 
with  R.  =  0  and  R0  =  3 


Figure  3.8.  The  Infinitesimal  Generator  for  the  Repair  Process 
with  R.  =  2  and  R„  =  1 


needs  to  be  determined.  The  repair  policy  represented  by 


the  vector  y  recommends  that:  whenever  the  system  is  in 


state  n  take  the  decision  y  (n)  ,  (e.g.,  if  in  state  1  then 


take  decision  1,  if  in  state  5  take  decision  3,  etc.).  Now, 


to  determine  the  corresponding  infinitesimal  generator  Q, 


we  use  the  following  algorithm: 


For:  n  =  1,  (M-^+l)  (M2+l) 


Q(n,m)  =  Q  (n)  (n ,m)  m  =  1 , .  .  .  ,  (f^+1 )  (M2  +  l ) 


The  preceding  discussion  for  determining  Q  will  be  clearer 


when  the  infinitesimal  generator  Q*  for  the  optimal  policy 


is  determined, 


Note  that  the  policy  decision  is  made  potentially  at 


each  state  change. 


In  an  attempt  to  search  for  the  most  favorable  (i.e., 


optimal)  policy  that  needs  to  be  followed  in  order  to  maxi¬ 


mize  the  readiness  of  the  squadron  we  maximize  the  expected 


number  of  aircraft  ready  to  engage  in  combat.  Table  3.2 


shows  the  total  number  of  aircraft  ready  to  engage  (f (n) ) 


for  the  various  states  of  the  process. 


TABLE  3.2 


NUMBER  OF  AIRCRAFT  OPERATIONAL  WHEN 
THE  PROCESS  IS  IN  STATE  (I,J) 


state: 

state: 

No.  of  Aircraft 

n 

(i/ j) 

f  (n) 

1 

(0,0) 

2 

2 

(0,1) 

2 

3 

(0,2) 

1 

4 

(0,3) 

0 

5 

(1,0) 

1 

6 

(1,1) 

1 

7 

(1,2) 

1 

8 

(1,3) 

0 

9 

(2,0) 

0 

10 

(2,1) 

0 

11 

(2,2) 

0 

12 

(2,3) 

0 

K.  RESULTS  AND  ANALYSIS 

1 .  Steady  State  Analysis 

For  any  policy  the  long-run  expected  number  of  air¬ 
craft  that  are  up  and  ready  to  engage  per  unit  time,  E[D  (<*)], 
can  be  calculated  by  multiplying  the  number  of  aircraft  up 
when  in  state  n  (f(n))  by  the  long-run  (limiting)  probability 
of  being  in  state  n  (tt  )  and  summing  over  all  possible  states 
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(M1+l) (M2+l) 

E  [  D  ( °° )  ]  =  y  f  ( n )  TT  ( ",  )  V  v 

^ ,  n 

n=l 

E[D(»)  ] 

where : 

{ tt 2.  (V)  t  •  •  •  /7T]_2  ^))  represents  the  steady-state 

distribution  of  the  state  of 
the  system  under  the  policy 
being  evaluated. 

The  state  space  consists  of  only  12  states. 

Since  all  states  communicate,  the  process  is  a 
regular  Markov  process.  Therefore  the  limiting  probabili¬ 
ties  exist.  The  resulting  optimal  policy  is  dependent  on 
the  number  of  aircraft,  modules  of  Type  1,  modules  of  Type 
2,  and  repairmen  assigned  to  the  base. 

2 .  Optimization  Results 

a.  Linear  Programming  Results 

The  results  of  applying  the  linear  programming 
optimization  approach  using  the  LINDO  package  are  shown 
below  in  Table  3.3.  The  resulting  optimal  policy  is  shown 
immediately  following  Table  3.3. 

This  optimal  policy  recommends  assigning  no 
repairmen  to  Shop  1  when  there  are  no  items  of  Type  1  down, 
assigning  one  repairman  to  Shop  1  when  there  is  an  item  of 
Type  1  down,  and  assigning  two  repairmen  to  Shop  1  when  there 
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TABLE  3.3 


LINEAR  PROGRAMMING  RESULTS 


V1} 

= 

.1180 

V2) 

= 

.  0990 

V3) 

= 

.0511 

V4) 

= 

.0105 

V5) 

= 

.2739 

tt2  ( 6) 

= 

.1536 

1^(7) 

= 

.0454 

TT -j_  (8) 

= 

.0120 

U> 

VO 

= 

.1629 

*2(10) 

= 

.0534 

*2 (11) 

= 

.0179 

*2 (12) 

= 

.0023 

1  2  3  4  5 

State  (0,0)  (0,1)  (0,2)  (0,3)  (1,0) 
Decision  00003 


6  7  8  9  10  11  12 

(1,1)  (1,2)  (1,3)  (2,0)  (2,1)  (2,2)  (2,3) 
2  1  1  3  2  2  2 


are  two  items  of  Type  1  down.  The  remaining  number  of 
repairmen  are  to  be  assigned  to  Shop  2  if  there  are  items  of 
Type  2  down  or  they  are  idle.  Following  this  policy  gives 
an  objective  function  value  (i.e.,  expected  number  of  air¬ 
craft  that  are  operational)  of  .9579.  This  policy  determines 
a  unique  bivariate-continuous-time  Markov  process  with  the 
following  infinitesimal  generator: 
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(2,3) 


Therefore,  by  assigning  the  repairmen  according 
to  the  optimal  policy,  the  resulting  stochastic  process 
can  be  assumed  to  be  a  bivariate-continuous-time-Markov 
proces  { X-^  (t)  ,X2  (t)  ; t  >_  0},  over  the  state  space 
S  =  {  ( 0 , 0) ,  (0 , 1) ,  ( 0 , 2 ) , . . . ,  (2 , 3) } ,  with  the  infinitesimal 
generator  Q*  and  initial  conditions: 

/I  if  n  =  0,  m  =  0 

pn  ™(o)  = 

n,m  J 

l  0  otherwise  . 

Such  a  process  has  the  limiting  probabilities 
shown  in  Table  3.3  and  an  expected  number  of  aircraft  ready 
to  engage  of  .9579. 

b.  Dynamic  Programming  Results 

The  results  of  applying  the  dynamic  programming 
procedure  are  given  in  Table  3.4.  The  optimal  policy  is 
shown  immediately  following  Table  3.4.  The  total  objective 
function  value  =  .9579. 

The  infinitesimal  generator  (Q*)  for  the 
continuous-time  Markov  process  resulting  from  the  application 
of  the  optimal  policy  is: 


TABLE  3.4 


DYNAMIC  PROGRAMMING  RESULTS 


TT3  (1 ) 

= 

.1180 

tt2  (2) 

= 

.0990 

tt1(3) 

= 

.0511 

"o(4) 

= 

.0105 

tt3(5) 

= 

.2739 

TT  2  (  6  ) 

= 

.1536 

TTX  (7  ) 

= 

.  0454 

TT  L  (  8  ) 

= 

.0120 

^3  (9) 

= 

.1629 

tt2(10) 

= 

.0534 

v  2  ( H ) 

= 

.0179 

n 2  (12) 

= 

.0023 

The  optimal  policy  is: 

1234  56789  10  11  12 

State:  (0,0)  (0,1)  (0,2)  (0,3)  (1,0)  (1,1)  (1,2)  (1,3)  (2,0)  (2,1)  (2,2)  (2,3) 

Decision:  321032113222 


I* 
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Suppose  the  squadron  is  assigned  6  aircraft, 

=  6  modules  of  Type  1,  and  =  7  modules  of  Type  2. 

The  repair  shop  supervisor  is  assigned  6  repairmen,  while 
the  remaining  parameters  are  the  same  as  in  the  previous 
example.  Table  (3.5)  gives  a  summary  of  the  results. 

It  shows  for  every  state  'n',  the  corresponding  (i,j)  state 
for  the  bivariate  process,  the  recommended  number  of  repair¬ 
men  to  be  assigned  to  Shop  1,  and  the  number  of  aircraft 
that  are  up  and  ready  to  engage  whenever  the  process  is  found 
to  be  in  state  (i,j).  Following  this  policy  the  squadron 
will  maintain  on  the  average  2.88  aircraft  up  at  any  time. 

L.  COMPARISON  OF  THE  DYNAMIC  PROGRAMMING  AND  THE  LINEAR 

PROGRAMMING  SOLUTIONS 

A  comparison  of  the  dynamic  programming  and  the  linear 
programming  approaches  shows  that  the  two  approaches  yield 
different  policies.  Table  3.6  shows  the  results  side  by  side. 

Both  approaches  gave  the  same  limiting  distribution  and 
hence  the  same  objective  value.  The  difference  in  the  opti¬ 
mal  policies  when  {X^(«=)  =  0}  suggests  that  there  is  more 
than  one  optimal  policy,  i.e.,  the  optimal  policy  is  not  unique 
This  is  intuitively  obvious  since  there  is  no  cost  asso¬ 
ciated  with  moving  repairmen  between  shops,  the  assignment 
of  idle  repairmen  to  Shop  1  versus  Shop  2  doesn't  affect 
the  objective  function  value. 

Both  approaches  resulted  in  the  same  infinitesimal 
generator  Q*,  and  since  both  processes  have  the  same  initial 


TABLE  3.6 


RESULTS  OF  BOTH  OPTIMIZATION  APPROACHES  SIDE  BY  SIDE 


State 

Decision : 

D-P 

Decision : 

L-P 

(0,0) 

3 

0 

(0,1) 

2 

0 

(0,2) 

1 

0 

(0,3) 

0 

0 

(1,0) 

3 

3 

(1,1) 

2 

2 

(1,2) 

1 

1 

(1,3) 

1 

1 

(2,0) 

3 

3 

'2,1) 

2 

2 

(2,2) 

2 

2 

(2,3) 

2 

2 

distribution,  therefore, 

it  may  be  concluded  that  both 

approaches  identified  the 

same  bivar iate-continuous-time 

Markov  process. 

Observe 

that 

whenever  the 

process  is  in  a  state 

(i,j)  such  that  i+j 

I  R' 

the  optimal  decision  will  always 

be  to  assign  i  repairmen 

to  Shop  1  and 

j  repairmen  to  Shop  . 

and  any  idle  repairmen  to 

either  shop. 

However,  if  i+j  >  R 

then  a  decision  has  to  be  made  to  determine  the  number  of 
repairmen  to  be  assigned  to  Shop  1. 
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Consider  the  state  (2,2). 


The  optimal  policy 


calls  for  assigning  2  repairmen  to  Shop  1,  and  a  single 
repairman  to  Shop  2.  This  shows  that  the  supervisor  is  giving 
a  priority  to  items  of  Type  1  since  both  aircraft  are  down, 
and  only  one  item  of  Type  1  is  needed  to  get  one  aircraft 
up. 

Consider  the  state  (2,3).  The  optimal  policy 
still  calls  for  the  assignment  of  2  repairmen  to  Shop  1,  and 
a  single  repairman  to  Shop  2.  This  shows  that  the  supervisor 
must  still  give  priority  to  items  of  Type  1,  even  though  an 
aircraft  requires  both  items  to  be  in  up  condition.  This 
is  due  to  the  difference  in  the  repair  rates,  p.  =  . 5  and 
^2  =  1  module  per  day.  Therefore,  it  takes  two  days  on  the 
average  to  repair  a  module  of  Type  1  and  one  day  to  repair 
a  module  of  Type  2.  To  carry  out  the  analysis  mathematically, 
define : 

U. .  =  Time  to  repair  the  ith  item  of  Type  1, 

1  i  =  1,2. 

U,  =  Time  required  to  repair  the  first  item  of 
Type  1. 

=  min{U11,Uk} 

Therefore,  U^,  i  =  1,2  are  two  independent  identically 
distributed  exponential  random  variables  with  rate 
Hence : 
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P{u^  >  t}  =  Pimin  (U^1 ,U12 )  >  t} 

=  P{U1X  >  t,U12  >  t} 

=  P{UL1  >  t}p{U12  >  t} 

-ylt  -ylt  -2u1t 

=  e  •  e  =  e 

Thus:  =  min{  '  ^22  ^  is  an  exPonent;'-a^  random  variable 

with  rate  2 y^.  In  the  example,  y^  =  .5.  Therefore  the  rate 
to  get  the  first  item  of  Type  1,  when  the  process  is  in 
state  (2,3)  with  2  repairmen  assigned  to  Shop  1,  is  1. 
Therefore,  on  the  average,  when  in  state  (2,3)  (i.e.,  all 

modules  are  down  and  2  modules  are  needed,  one  of  each  type, 
to  get  an  aircraft  up) ,  it  takes  on  the  average  one  day  to 
get  the  first  aircraft  operational.  If  the  supervisor  has 
assigned  only  one  repairman  to  Shop  1  and  2  to  Shop  2 ,  then 
it  will  take  on  the  average  2  days  to  get  a  module  of  Type  1 
up.  By  following  the  above  analysis  for  Type  2  modules,  it 
will  take  on  the  average  1/2  day  to  get  the  first  module. 
However,  an  aircraft  requires  both  types  to  be  considered 
up.  Therefore  on  the  average  it  will  take  2  days  to  get  the 
first  aircraft  up.  The  preceding  analysis  supports  the  deci¬ 
sion  provided  by  the  optimal  policy. 

As  shown  earlier,  the  decisions  to  be  taken 
whenever  the  process  is  in  a  state  (i,j)  such  that  i+j  R 
(R  =  3)  is  trivial.  To  determine  if  the  resulting  repair 
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policy  is  indeed  optimal,  a  Fortran  program  was  written 
to  evaluate  all  possible  policies.  This  is  done  by 
considering  all  possible  decisions  that  could  be  taken 
whenever  the  process  is  found  in  state:  (1,3),  (2,2), 

or  (2,3).  Table  (3.7)  shows  all  possible  policies,  the  corres¬ 
ponding  limiting  probabilities  of  the  resulting  process  and 
the  objective  function  value.  It  is  clear  that  the  repair 
policy  suggested  by  both  the  linear  programming  and  the 
dynamic  programming  approaches  are  optimal  policies,  resulting 
in  the  same  Markov  process. 

The  linear  programming  approach  has  the  advantage 

of  the  widespread  availability  of  commercial  packages  for 

use  (e.g.,  LINDO  and  MPS  III).  An  additional  advantage  of 

the  linear  programming  approach  is  the  ability  to  easily 

conduct  sensitivity  analyses.  However,  for  large  numbers  of 

modules,  aircraft  and  repairmen,  the  linear  programming  approach 

may  be  impractical.  It  seems  that  the  dynamic  programming 

approach  is  more  suitable  for  the  larger  size  problems  because: 

It  requires  less  data  input  and  preparation. 

There  might  be  a  possibility  of  degenerate  solutions  in 
linear  programming  which  will  yield  an  impractical 
optimal  solution  (e.g.,  in  the  case  when  there  are 
round-off  errors  in  calculating  the  rates  such  that 


(Ml+1) (M2+l) 
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doesn't  equal  1  exactly) 
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IV.  FORMULATION  AND  ANALYSIS  OF  SOME  COMBAT  MODELS 


A.  INTRODUCTION 

In  order  to  formulate  Combat-Logistics  models,  consider¬ 
ation  of  some  relevant  combat  situations  are  necessary.  This 
chapter  presents  an  analysis  of  an  air  defense  scenario  for 
a  relatively  small  country,  or,  alternatively,  an  area  (or 
sector)  of  responsibility  to  a  defense  system.  The  air  defense 
system  is  assumed  to  consist  of: 

1.  An  interceptor  squadron  made  up  of  a  relatively  small 
number  of  aircraft  equipped  to  engage  in  air-to-air 
combat . 

2.  A  Surf ace-to-Air  system  that  consists  of  a  number  of 
Surface-to-Air  Missile  (SAM)  batteries,  and  Anti- 
Aircraf t-Artillary  (AAA)  batteries. 

3.  An  early  warning  system  that  has  a  long  range  radar, 

and  uses  information  from  an  airborne  warning  and  control 
system  (AWACS)  operated  by  friendly  forces. 

4.  A  command,  control  and  communication  (C3 4)  system. 

The  air  defense  system  is  responsible  for  defending  against 
any  hostile  air  attack  from  a  hostile  agent,  e.g.,  nation. 
Suppose  that  the  objective  of  the  air  defense  system  is  to 
absorb  the  initial  strike;  after  the  initial  campaign  it  is 
assumed  that  there  will  be  some  support  from  other  friendly 
agents.  The  term  "absorb"  means  to  cause  maximum  possible 
reduction  of  the  hostile  damage  to  the  area  being  defended. 
Consider  the  following  threat  scenario  that  the  air  defense 
system  might  encounter.  A  hostile  attack  occurs 
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unexpectedly  with  multiple  bombers;  the  attack  objective  is 
to  destroy  some  high-valued  military  and/or  national  targets. 

The  bombers  appear  in  a  wave,  i.e.,  essentially  simultaneously. 

It  is  assumed  that  the  air  defense  doctrine  dictates  that 
for  any  incoming  threat,  the  air  interceptor  squadron  will 
first  engage  the  threat  until  the  threat  reaches  a  certain 
imaginary  line  (set  by  doctrine) ;  surviving  bombers  that  cross 
the  line  are  attacked  by  the  SAM  units.  The  imaginary  line 
will  be  referred  to  as  the  hand-over  line,  and  the  term  "threat" 
means  the  enemy  bombers.  Therefore,  the  time  required  by  the 
threat  to  reach  the  hand-over  line  from  time  of  detection 
determines  the  time  that  is  possible  for  the  air  interceptors 
to  engage  the  threat.  At  a  later  time  (or  shorter  range)  the 
SAM  units  will  engage  until  the  threat  reaches  yet  another 
hand-over  line,  at  which  point  the  AAA  system  will  take  over 
to  engage  the  surviving  threat  elements.  At  each  line  the 
leakage  from  the  stage  before  must  be  dealt  with  by  the  system 
in  question.  Figure  (4.1)  illustrates  the  above  scenario. 

Notice  that  each  stage  constitutes  a  different  type  of 
combat;  the  leakage  from  that  stage  provides  the  input  for  the 
stage  following.  For  example,  the  leakage  of  the  air-to-air 
combat  process  is  the  input  to  the  SAM-to-bombers  engagement 
process  (e.g.,  the  number  of  bombers  to  be  engaged  by  SAM). 

A  feasible  enemy  doctrine  dictates  that  the  mission  of 
the  bombers  is  to  be  aborted  as  soon  as  the  number  of  bombers 
surviving  the  combat  drops  below  a  certain  number. 
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Figure  4.1.  Stages  of  Air-Defense  Combat 


j  This  study  presents  various  models  for  the  air-to-air 

i 

!  combat  process;  these  models  will  facilitate  the  linking  of 

•  the  operational  logistics  models  presented  in  the  previous 

chapters  to  produce  the  desired  combat-logistics  models.  The 
combat-logistics  models  allow  the  decision  maker  to  explicitly 
relate  combat  outcomes  to  logistics  system  scale  and  organization. 

Some  of  the  relevant  measures-of-ef f ectiveness  (MOE's)  for 

i 

|  the  air-interceptor  squadron  are  the  following: 

1.  The  expected  number  of  bombers  reaching  the  first  hand¬ 
over  line;  this  measure  is  to  be  minimized.  This  step 
minimizes  the  expected  number  of  bombers  that  will  be 
engaged  by  the  SAM  units. 

I 

2.  The  probability  that  exactly  z  (z  £  B(0)),  or  no  more 
than  z,  bombers  leak  through  stage  1.  Particular  inter¬ 
est  may  well  be  in  z  =  0 .  The  above  measure  is  more 
general  than  the  first-mentioned  measure,  but  is  also 

|  more  difficult  to  compute.  Diffusion  approximations 

evaluate  this  measure  in  terms  of  the  mean  and  variance 
of  the  leakage  at  hand-over  time. 

3.  The  duration  of  the  air-to-air  combat.  Extending  the 

i  combat  duration  will  delay  the  bombers  from  reaching 

[  the  first  hand-over  line.  In  turn,  this  will  result 

i  in  the  bombers  burning  more  fuel,  which  might  result 

in  bombers  aborting  their  mission.  This  MOE  in 
turn  will  also  allow  the  SAM  units  longer  warning 
time  to  prepare  for  combat.  The  manner  in  which 
air-to-air  combat  duration  can  be  increased  is  by 
the  range  of  first  detection;  which  is  a  factor  we 
study  in  the  next  chapter. 

The  general  measure  of  the  effectiveness  of  the 
air-interceptor  squadron  that  will  be  considered  (modelled 

J  and  optimized)  in  this  study  is  to  minimize  the  probability 

!  of  penetration  of  the  enemy  bombers.  Here  the  term  "penetra- 

I 

tion"  refers  to  the  ability  of  the  enemy  bombers  to  reach  an 

i 

|7  imaginary  line  (hand-over  line)  beyond  which  lies  an  important 
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defense  asset  (e.g.,  SAM  units),  or  beyond  which  the  threat 
will  release  its  load  (i.e.,  bomb-release  line). 

Air- interceptor  squadrons  usually  fight  with  a  homogeneous 
set  of  aircraft.  The  squadron  should  be  equipped  so  that  it 
is  capable  of  defeating  an  anticipated  threat  force.  The 
opposing  force  structure  at  the  beginning  of  a  combat  period 
(t  =  0)  is  represented  mathematically  by  the  vector  (B(0),D(0)), 
where : 

B(0)  =  The  number  of  enemy  Bombers  at  the  beginning 

of  the  combat  period. 

D(0)  =  The  number  of  Defending  aircraft  at  the 

beginning  of  the  combat  period. 

Here  the  term  "combat  period"  refers  to  the  period  during  which 
the  defenders  and  attackers  (bombers)  will  meet  in  combat.  It 
effectively  begins  when  the  bombers  are  in  the  range  of  the 
defenders.  The  duration  of  the  combat  period  can  be  lengthened 
by  extending  the  warning  range.  The  study  assumes  that  this 
duration  is  deterministic.  It  could  be  provided  by  the  decision 
maker  (e.g. ,  points  in  time  at  which  the  decision  maker  is 
interested  in  knowing  the  opposing  force  distribution) ,  or 
could  be  the  time  for  the  bombers  to  fly  from  point  of  detection/ 
intercept  to  hand-over  line. 

B.  PROBLEM  CHARACTERISTICS 

The  study  considers  two  features  of  the  combat  situation: 
the  early  warning  process,  and  the  air-to-air  combat  process. 


1 .  The  Early  Warning  Process 

The  early  warning  process  consists  of  the  following 
operations . 

a.  Radar  Detection  of  a  Hostile  Attack 

Radar  locates  an  aerial  target  in  azimuth,  range 
and  altitude.  It  then  estimates  the  target  course,  speed  and 
strength  (number  of  attacking  bombers) .  The  radar  character¬ 
istics  (particularly  range)  depend  primarily  upon  the  type 
and  performance  of  the  radar  used,  as  well  as  the  altitude 
selected  for  the  antenna. 

b.  Target  Identification 

Identification  enables  targets  to  be  classified 
in  various  categories  (e.g.,  friendly,  hostile,  or  unidenti¬ 
fied)  .  So  a  secondary  radar  which  is  identification — friendly 
or  foe  (IFF) — has  to  be  used. 

c.  Threat  Evaluation 

This  phase  evaluates  a  threat  index,  which  depends 

upon : 

The  size  of  the  attacking  force. 

Geographical  location. 

The  required  flight  time  to  the  high  valued  ground 

targets  or  installations. 

d.  Transmission  of  the  Warning 

Warning  is  transmitted  to  all  air  defense  units 


(for  example,  interceptor  squadron,  SAM  batteries,  and  the 
AAA  units)  and  also  to  the  areas  being  defended  and  even  the 
civil  population  (shelters) . 


Successful  execution  of  the  above  operations  or 


missions  is  affected  by  factors  such  as: 

Radar  range;  the  reliability  and  maintainability  of 
the  equipment,  including  adequacy  of  spare  parts  and 
maintenance  facility,  and  equipment  calibration. 

Training,  skill,  motivation,  vigilance  of  the  operators. 

Operational  doctrine  of  the  early  warning  system. 

The  availability  of,  and  coordination  with,  supplementary 
detection  system. 

Such  supplementary  systems  include  other  friendly 
early  warning  systems  in  the  area,  as  well  as  possible  infor¬ 
mation  from  neighboring  allied  countries. 

The  objective  of  the  early  warning  system  assumed 
for  this  study  is  to  maximize  the  time  available  for  combat, 
by  detecting  the  enemy  threat  far  enough  in  advance  to  launch 
the  air- interceptor  squadron,  so  as  to  engage  the  incoming 
threat  the  longest  possible  time  before  reaching  their  bomb- 
release  line.  It  is  assumed  that  the  longer  is  the  available 
time  for  engagement  (combat) ,  the  greater  is  the  likely  reduc¬ 
tion  in  the  incoming  threat. 

2 .  The  Air-to-Air  Combat  Process 

After  detection  of  the  incoming  threat,  and  identified 
as  hostile  targets,  the  engagement  of  targets  by  the  air- 
interceptor  squadron  requires  the  following  steps, 
a.  Scrambling  All  Operational  Aircraft 

The  scramble  time  is  measured  from  announcement  of 
the  alert  to  the  pilots  until  take-off.  This  time  consists 
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of  the  time  needed  to  start  the  aircraft  engines,  the  time 
required  to  align  the  instruments,  and  the  taxiing  time, 
b.  Target  Designation  and  Engagement 

This  step  consists  of  assigning  an  enemy  bomber, 
selected  according  to  its  threat  index,  to  the  aircraft  most 
suited  to  achieve  target  interception  and  destruction.  The 
outcome  of  the  engagement  is  highly  dependent  on  factors  such 
as : 

Defender:  Acceleration  capability  and  tolerance,  condi¬ 

tional  kill  probabilities  given  a  hit,  bomber  silhouette 
dimensions,  and  the  statistical  nature  of  the  projectile 
(missiles  and/or  guns)  versus  target  range.  Skill  and 
training  of  the  pilots  also  has  an  influence  on  the 
outcome  of  the  engagement,  together  with  the  rate  of 
fire  that  can  be  achieved  by  the  weapon  system. 

Bomber:  Availability  and  usage  of  electronic  counter¬ 

measure,  accuracy  of  its  defensive  air-to-air  weapon 
system,  the  amount  of  load  carried,  skill  and  motivation 
of  pilots,  and  familiarity  of  pilots  with  defender's 
tactics . 

The  reliability  and  effectiveness  of  the  command  and 
control  system,  and  the  skill  and  training  of  the  ground 
operators . 


C .  MODELLING  APPROACH 

The  complex  problem  of  describing  the  interaction  among 
the  different  variables,  resulting  from  considering  all  of 
the  preceding  combat  factors  in  detail,  makes  the  use  of  a 
high-resolution  combat  simulation  appear  necessary  for  repre¬ 
senting  the  combat  process  in  detail,  i.e.,  at  a  "micro" 
level.  In  this  chapter  we  will  represent  the  combat  process 
alternatively  and  at  a  simple  "macro"  level  by: 


1.  Deterministic  (differential  equations)  models. 

2.  Diffusion  processes. 

3.  Continuous-time-discrete-state  Markov  process. 

Such  representations,  as  will  be  seen,  allow  useful 

calculations  to  be  made  analytically.  The  models  do  not, 
however,  recognize  all  detailed  constraints  to  which  the  com¬ 
bat  process  is  subject.  Nevertheless,  they,  or  their  exten¬ 
sions,  provide  useful  guidance  to  a  decision  maker. 

The  viewpoint  taken  to  obtain  macro-level  combat  models 
is  familiar,  see  Taylor  (1983).  At  any  point  of  time  during 
the  combat  process,  a  defender  aircraft  can  be  found  to  be 
either  (i)  engaging  an  enemy  bomber,  (ii)  free  and  looking 
for  a  free  bomber,  or  (iii)  killed.  Similarly,  an  enemy 
bomber  can  be  found  to  be  either  engaged  by  a  defender  aircraft 
or  free  and  trying  to  avoid  being  detected  or  found  by  defender 
aircraft,  or  killed.  Suppose  that  we  assume  fight  to  the 
finish;  that  is,  once  a  defender  aircraft  detects  and  engages 
an  enemy  bomber,  the  one-to-one  engagement  process  will  con¬ 
tinue  until  either  the  bomber  is  killed  or  the  defender  air¬ 
craft  is  killed.  (Note  that  only  one  free  defender  can  engage 
a  free  bomber.)  Under  this  scenario  the  combat  process  can 
be  represented  by  the  state  vector  {B  (t)  ,C  (t)  ,D  (t)  ;  t  0 } 
where : 

B  (t )  =  The  number  of  enemy  Bombers  free  (and 

alive)  at  time  t, 

C ( t )  =  The  number  of  enemy  bombers  (in  turn 

defender  aircraft)  in  Combat  (i.e., 
engaged)  at  time  t, 


D  ( t ) 


The  number  of  Defender  aircraft  free  (and 
alive)  searching  for  a  free  bomber  at  time 
t. 


Let  aD  be  the  rate  at  which  an  individual  defender  in 
combat  with  a  bomber  kills  that  bomber  (or  causes  a  bomber 
to  become  ineffective) ;  and  a  be  the  rate  at  which  an  indi- 
vidual  bomber,  in  combat  with  a  defender,  kills  that  defender 
(or  causes  the  defender  to  become  ineffective) . 

Define  0  to  be  the  rate  at  which  an  individual  free  defender 
detects  and  starts  engaging  a  free  bomber,  i.e.,  0  is  the 
re-engagement  rate.  The  units  for  these  variables  are  given 
below: 


defenders  killed 
aB  1S  (bombers) (time) 

bombers  killed 
aD  1S  (defenders) (time) 


bombers  engaged 
1S  (defenders) (time) 

Note  that  the  total  number  of  bombers  alive  at  time  t  is 
given  by  B(t)  +  C(t),  and  the  total  number  of  defenders  alive 
at  time  t  is  given  by  D(t)  +  C(t). 

Next,  the  simplest  representations  for  the  variables 
B(t),  C(t),  D ( t )  will  be  presented:  the  process  of  mutual 
attrition  is  taken  to  be  deterministic. 

D.  DETERMINISTIC  MODELS 


To  simplify  the  representation  of  the  combat  process 
analysis,  we  introduce  a  deterministic  representation  of  the 
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process  by  suppressing  its  randomness.  Such  a  deterministic 
model  often,  as  will  be  seen  later,  results  in  representations 
that  deviate  somewhat  from  the  expectations  of  more  sophis¬ 
ticated  stochastic  process  models;  such  deviations  may  be 
referred  to  as  the  bias  of  the  deterministic  model.  Usually 
the  bias  becomes  small  as  B(0)  and  D(0)  increase. 

1.  The  Finite  Re-Engagement  Rate  Combat  Model;  (the 

BCD  Model) 

First  consider  the  situation  described  in  the  previ¬ 
ous  section  in  which  9,  the  re-engagement  rate,  is  finite. 

3 

The  parameter  9  presumably  increases  if  the  defense  C  system 
is  improved,  but  no  attempt  is  made  here  to  model  C^  in  a 
detailed  manner. 

Define  the  following  functions: 

*  b(t),  a  representation  of  the  number  of  bombers 
free  and  alive  at  time  t,  given  the  initial 
number  of  bombers  and  defenders  entering  combat 
initially. 

c(t),  a  representation  of  the  number  of  bombers 
and  defenders  engaged  in  combat  at  time  t,  given 
the  initial  number  of  bombers  and  defenders  enter¬ 
ing  combat  initially. 

•  d(t),  a  representation  of  the  number  of  defenders 
free  and  alive  at  time  t,  given  the  initial  num¬ 
ber  of  bombers  and  defenders  entering  combat 
initially. 


RESULT  (4.1): 

A  deterministic  model  for  the  above  scenario  is  given  by 
the  following  system  of  differential  equations: 


a  c(t)  -  9b(t)d(t) 

■  =  6b(t)d(t)  -  (aB+aD)c(t)  (4.1) 

d^-£—  =  aDc(t)  -  8b(t)d(t) 

with  initial  condition: 

b(0)  =  B  ( 0 ) 

c  (0 )  =  C  (0)  =  0 

d(0)  =  D  ( 0 ) 

The  argument  from  which  the  equations  is  derived  is 
as  follows. 

The  first  equation  of  (4.1)  represents  the  rate  of 
change  of  b(t)  with  time.  The  term  a_.c(t)  represents  the 
expected  increase  in  b(t)  caused  by  a  bomber  killing  a  defender 
while  the  term  0b(t)d(t)  represents  the  decrease  in  b(t) 
caused  by  a  free  defender  detecting  and  engaging  a  free  bomber. 

The  second  equation  of  (4.1)  represents  the  rate  of 
change  of  c(t)  with  time.  The  term  Gb(t)d(t)  is  the  expected 
increase  in  c(t)  caused  by  a  free  defender  detecting  and 
engaging  a  free  bomber,  while  the  term  (aD+an)c  (t)  represents 
the  decrease  in  c(t)  caused  by  a  bomber  killing  a  defender, 
or  by  a  defender  killing  a  bomber. 


db  ( t ) 
dt 


The  third  equation  of  (4.1)  represents  the  rate  of 


change  of  d(t)  with  time;  the  argument  used  for  writing  this 
equation  is  the  same  as  that  for  the  first  equation. 

Equations  (4.1)  can  be  solved  numerically  using  Runge- 
Kutta  method  (Gerald,  1984)  but  not  in  simple  explicit 
closed  form.  However,  a  limiting  analysis  can  be  as  follows. 

Adding  the  first  equation  of  (4.1)  to  the  second,  and 
the  third  equation  to  the  second  of  (4.1),  we  get: 


d{b  (t)  -t-c  (t)  } 
dt 


-  a. 


c  (t) 


d{d  (t)  + c  (t) } 
dt 


&B  c (t) 


(4.2) 


Define  the  following: 

b(t),  a  representation  of  the  total  number  of  bombers 
alive  at  time  t,  and 

d(t),  a  representation  of  the  total  number  of  defenders 
alive  at  time  t. 

Then : 


b  (t)  =  b  (t)  +  c  ( t) 

d  (t)  =  d  (t)  +  c  (t) 

Substituting  (4.3)  into  (4.2),  we  obtain: 


(4.3) 
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db 

d 


dd'„ 
dt 


-  c*B  c  (t) 


From  (4.4),  we  get : 


,  db(t) 
B  dt 


dd(t] 
D  dt 


Integrating  both  sides  of  (4.5),  we  obtain: 


afi[b(t)  -  b  (0)  ]  =  aD[d(t)  -  d  (0)  ]  ,  Vt 


But  from  the  initial  conditions: 


b  ( 0 )  =  B  ( 0 )  +  C(0)  =  B  ( 0 ) 


d  ( 0 )  =  D  ( 0 )  +  C(0)  =  D  ( 0  ) 


Therefore  (4.6)  becomes: 


c<B  [b  ( t)  -  B  (0)  ]  =  otD  Ed  (t)  -  D  (0)  ]  Vt 


Since  a  ,  a  and  c(t)  assume  nonnegative  values, 

B  U 

(4.4)  indicates  that  b(t)  and  d(t)  are  both  nonincreasing 
functions  (as  they  should  be) . 


(7*v 


a.  Criterion  for  Defenders  to  Win,  BCD  Model 

A  criterion  for  the  defenders  to  win  can  be 
obtained  by  noting  that,  in  order  to  conclude  that  defenders 
won,  it  must  be  assumed  that  b(°°)  =  0,  and  d(°°)  >  0.  Using 
this  assumption,  and  letting  t  -*■  °°,  (4.7)  becomes: 

aDd(°°)  =  aDD(0)  -  afiB  (0 )  (4.8) 

Since  afi,  aD»  d(“)  are  all  positive  values,  then: 

anD(0)  -  a  B ( 0 )  >  0 

U  B 

Therefore,  for  the  assumption  that  defenders  win  to  be  true, 
we  must  have: 

aDD(0)  >  aBB(0)  (4.9) 

Hence,  the  condition  for  the  defenders  to  win  is 
expression  (4.9).  if  the  inequality  is  reversed,  bombers 
win,  i.e.,  some  bombers  survive. 

Equation  (4.8)  also  shows  that: 

anD(0)  -  a_B  (  0 ) 

d(«)  =  — - - - - -  (4.10) 

aD 

Therefore,  the  deterministic  approximation  for 
the  number  of  defenders  eventually  surviving  combat  is 
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independent  of  the  rate  of  engagement  -3  .  This  is  not  sur¬ 
prising,  since  time  extends  indefinitely.  Of  course  an  equa¬ 
tion  comparable  to  (4.10)  predicts  (approximately )  the 
expected  number  of  bombers  surviving  if  (4.9)  is  reversed. 

2 .  The  Infinite  Re-Engagement  Rate,  Invulnerable 
Defender  Model 

To  simplify  the  representation  of  the  combat  process 
we  can  assume  an  Invulnerable  defender's  model  (I  scenario). 
Under  the  I  scenario,  we  assume  that  the  air  defense  system 
has  a  perfect  C~*  system  represented  by  having  9  =  °°,  and  that 
defenders  are  invulnerable,  i.e.,  a_  =  0,  and  only  one-to-one 
engagement  is  allowed. 

a.  Deterministic  Model  for  I  Scenario 

Under  the  I  scenario  assumptions,  the  combat 
process  can  be  modelled  deterministically  by  the  following 
differential  equation: 


db(t) 

dt 


-a  D(0)  if  b ( t)  >  D  ( 0 ) 

-aDb(t)  if  b(t)  <  D  ( 0 ) 


(4.11) 


with  initial  condition: 

b  (0  )  -  B  (  0 ) 


Equation  (4.11)  represents  the  rate  of  change  of 
b(t)  with  time.  At  any  point  in  time  if  b(t)  •  D(0)  then  all 
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defenders  are  in  engagement  (i.e., 
there  are  b(t)  -D(0)  free  bombers.  This  is  represented  by 
the  term  a^D(O).  If  b(t)  <  D(0)  then  all  bombers  are  being 
engaged  (i.e.,  no  free  bombers),  and  there  are  D(0)  -b(t) 
free  defenders,  which  justifies  the  term  -anb(t). 


as  follows: 


The  solution  for  equation  (4.11)  can  be  derived 


Define : 


t*  =  inf(t:  t  >  0,  b(t)  <  D ( 0 )  } 


Then,  equation  (4.11)  becomes: 


db(t) 

dt 


aDD(0) 


aDb  ( t) 


for  t  <  t< 


for  t  >  V 


(4.12) 


where : 


b(0)  =  B  ( 0 ) 


Note  that  if  B(0)  <  D(0),  then  t*  =  0;  and  the 


solution  for  (4.12)  is  given  by: 


aD^ 

b  (t )  =  B  ( 0 )  e  u  for  t  >  0 


(4.13) 


Suppose  B ( 0 )  >  D(0).  Then  equation  (4.12)  says 
that  there  exists  a  time  point,  t*,  such  that  for  any  time 
point  t  less  than  t*,  0  £  t  £  t*,  the  rate  of  change  of  b(t) 
is  -aDD(0).  Recall  that  only  one  defender  can  engage  a  free 
bomber,  so  while  bombers  outnumber  defenders,  the  rate  of 
decrease  is  proportional  to  the  defender  numbers.  After  the 
point  t*,  b(t)  declines  below  D(0),  where  its  rate  of  change 
becomes  -aDb(t). 

For  t  <  t*,  we  have 


db  ( t ) 
dt 


-aDD(0) 


Integrating  both  sides,  and  using  the  initial 


condition,  we  obtain: 


b  (t )  =  B  ( 0 )  -  otj-jD  (0)  t  for  t  £  t*  (4.14) 


For  t  >  t*,  we  have: 


db(t)  = 
dt 


-aDb(t) 


Adding  aDb(t)  to  both  sides,  multiplying  by  e  , 


and  integrating,  we  obtain: 


a~t  a.  „t* 

e  b(t)  -  e  b(t*)  =  0  for  t  >  t*  (4.15) 
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From  (4.14),  we  obtain: 


b(t*)  =  B  (0 )  -  aDD(0)t*  , 


~aDt 


substituting  into  (4.15)  and  multiplying  by  e  ,  we  obtain 


-a  (t-t*) 

b ( t)  =  (B (0 )  -  aQD ( 0 )  t*)  e  for  t  >  t*  (4.16) 


Hence,  from  (4.14)  and  (4.16),  it  follows  that: 


B  ( 0 )  -  aDD(0)t 


for  t  <  t* 


b  ( t )  = 


-a  (t-t*) 

(B  (0)  -aDD(0)t*)e  for  t  >  t* 


From  the  definition  of  t*,  we  have: 


b  (t*)  -  D  (0 ) 


Substituting  into  (4.17)  we  get: 


b  ( t* )  =  B  (0  )  -  aDD(0)t*  -  D  (0 ) 


Hence, 


t*  -  (B  (0  )  -  D  ( 0 )  )./aDD(0) 


(4.17) 


. . fl - C . 
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Equation  (4.17)  permits  the  easy  direct  computa¬ 


tion  of  b(t),  the  approximation  for  the  number  of  bombers 
alive  at  various  points  of  time  during  the  combat  period. 

Note  that  in  the  preceding  analysis  we  have 
assumed  that  the  force  levels  are  continuous  variables.  This 
is  an  assumption  that  we  had  to  make  in  order  to  use  the 
above  differential  equation  models  to  develop  deterministic 
representation  for  the  evolution  of  the  combat  process.  The 
tacit  assumption  of  a  deterministic  process  is  perhaps  even 
more  questionable.  Thus,  we  should  develop  stochastic  analogues 
for  the  above  deterministic  models.  A  natural  procedure  is 
to  utilize  diffusion  models;  see  Feller  (1971). 

In  the  development  of  our  diffusion  models 
we  assume:  (i)  continuity  of  the  force  level  variables, 
and  (ii)  Gaussian  increments  included  in  the  process. 

We  first  consider  a  deterministic  model,  and  then  develop 
its  stochastic  analogue  by  representing  the  evolution  of  the 
combat  system  by  a  diffusion  process,  i.e.,  as  if  it  evolves 
with  independent  Gaussian  increments.  Since  the  force 
levels  ( B ( t ) , D ( t ) )  are  assumed  to  be  continuous,  the 
diffusion  mathematics  result  in  a  mean  and  a  covariance  matrix 
that  are  approximations  to  the  corresponding  matrices  that 
would  occur  if  the  process  was  modelled  by  a  continuous-time , 
discrete-state  Markov  process.  However,  diffusions  often 
yield  good  approximations  with  improvements  occurring  for 
large  force  level  (B(0)  -»■  °°,  D(0)  -*■  °°)  .  It  follows  that  the 


diffusion  approximation  can  be  used  to  approximate  the  MOE 
under  study,  which  requires  approximating  the  probability 
distribution  of  the  number  of  free  bombers  at  time  t. 


E.  DIFFUSION  MODELS  FOR  AIR-TO-AIR  COMBAT 

Following  the  arguments  in  Gaver  and  Lehoczky  (1977a) , 
we  now  formulate  the  combat  processes  resulting  from 
modelling  the  previous  scenarios  by  diffusion  processes. 
Since  we  assume  the  continuity  of  the  state  variables, 
we  will,  therefore,  adopt  the  following  notation: 


B ( t )  a  stochastic  diffusion  representation  for  the 
number  of  bombers  free  (and  alive)  at  time  t, 


C(t)  a  diffusion  representation  for  the  number  of 

bombers  (hence  defenders)  in  engagement  at  time  t, 
and 


D ( t )  a  diffusion  representation  for  the  number  of 
defenders  free  (and  alive)  at  time  t. 


1.  Diffusion  Model  for  the  BCD  Scenario 


Define  N  to  be  the  total  number  of  aircraft  of  both 
forces  available  for  combat  initially,  i.e.,  N  =  B(0)  +  D(0). 
We  aim  to  characterize  the  air-to-air  combat  process  approxi¬ 
mately  when  N  -+  <»,  by  treating  (B  (t)  ,C  (t)  ,D  (t)  ;  t  ^  0}  as 
a  trivariate  diffusion  process.  When  N  -*■<»,  we  mean  that 
B  ( 0 )  ■+  <»  and  D(0)  -►  °°  simultaneously  and  in  a  fixed  proportion. 

The  behavior  of  the  system  state  vector,  {B(t),C(t), 
D(t);  t  >_  0 }  ,  can  be  modelled  directly  by  writing  it  in  the 
form  of  an  Ito  stochastic  differential  equation  as  follows: 
Arnold  (1974) 
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dB(t) 


where  (W^  (t )  ,^2  ( t)  ;  t  0}  is  a  bivariate  standard  Wiener 
process  whose  components  are  independent.  That  is,  each  com¬ 
ponent  is  normally  distributed  with  zero  mean  and  variance 
dt . 

The  rationale  for  writing  (4.18)  is  as  follows.  The 
dt  terms  represent  the  drift  or  the  expected  behavior  of  the 
state  variable,  [B (t) ,C  (t) ,D (t) ] ,  between  t  and  t+dt.  As 
viewed  by  Gaver  and  Lehoczky  (1977a) ,  the  evolution  of  the 
process  can  be  considered  as  being  that  of  a  locally  Poisson- 
ian  process  of  rate  afiC(t),  8B(t)D(t)  and  aDC(t)  for  B(t),  C(t) 
and  D ( t )  respectively,  with  the  average  output  rates  being 
6B(t)D(t),  (aB+aD)C(t)  and  9B(t)D(t),  respectively. 

The  term  aQC(t)  in  the  first  equation  of  (4.18) 

O 

represents  the  expected  increase  in  B(t)  caused  by  a  bomber 
killing  a  defender,  while  the  term  of  aDC(t)  in  the  third 


equation  represents  the  expected  increase  in  D(t)  caused  by 
a  defender  killing  a  bomber.  The  term  6B(t)D(t)  used  in 
equations  (4.18)  represents  the  decrease  in  B(t)  (hence  D(t)), 
and  the  increase  in  C(t),  caused  by  a  free  defender  detecting 
and  engaging  a  free  bomber.  The  variance  of  the  Poisson 
equals  the  mean,  and  for  large  parameter  values  (in  this 
case  large  number  of  initial  bombers  and  defenders)  the  Poisson 
is  approximately  Gaussian;  this  heuristically  justifies  the 
coefficient  of  the  Wiener  process  terms,  and  the  Wiener  terms 
themselves.  An  increase  in  B(t)  indicates  a  decrease  in  the 
total  number  of  defenders  alive  (D(t)  +  C(t));  and  vice 
versa.  This  is  represented  by  the  coefficients  of  the  Wiener 
processes  in  the  first  equation  of  (4.18)  having  opposite 
signs  than  the  corresponding  terms  in  the  third  equation. 

Consider  the  linear  transformation; 

B(t)  =  Nb (t)  +  /N  Xx (t) 

C(t)  =  Nc (t)  +  /N  X2(t)  (4.19) 

D  ( t )  =  Nd  (t)  +  /N  X3  (t) 

where:  b(t),  c(t),  and  d(t)  are  deterministic  functions  of 

time;  being  approximations  to  the  process  means  which  need 
to  be  determined.  (X^(t);  t  >_  0 }  ,  i  =  1,2,3,  are  stochastic 


elements  all  of  which  need  to  be  determined.  Justification 


of  such  transformations  is  given  by  Gaver  and  Lehoczky  (1977a). 
Differentiating  (4.19),  we  obtain: 


dB  (t )  =  Ndb(t)  +  /N  dXL(t) 

dC  (t )  =  Ndc(t)  +  /N  dX2(t)  (4.20) 

dD  ( t )  =  Ndd(t)  +  /N  dX3(t) 

Suppose  Xi(0)  =  0,  i  =  1,2,3.  Then  from  (4.19),  we 

obtain : 


b  (0) 

c  (0) 

d  (0) 


B  (0 ) 
N 


D(0) 

N 


(4.21) 


Let  0  =  0N  be  constant  as  N  i.e.,  assume  that 

0  is  small  enough  so  that  0N  -*  constant  as  N  +  ®.  This  means 
that  on  the  average  a  defender  takes  a  relatively  long  time 
co  detect  and  engage  a  bomber. 

Now,  substituting  (4.19)  and  (4.20)  into  (4.18),  and 


isolating  terms  of  order  N  and  /N  and  letting  N 
obtain  the  following  sets  of  equations. 


°° ,  we 


a.  Deterministic  Equations 

The  terms  of  order  N  yield: 

aBc(t)  -  0b(t)d(t) 

0b(t)d(t)  -  (aB+aD)c(t)  (4.22) 

aDc(t)  -  eb(t)d(t) 

with  initial  conditions  given  by  (4.21). 

The  solution  to  these  equations,  which  is  obtained 
by  numerical  integration,  provides  a  deterministic  approxi¬ 
mation  to  the  means  of  the  process.  Note  that  equations  (4.22) 
are  equivalent  to  equations  (4.1)  where, 

b  (t)  =  Nb  ( t) 

c(t)  =  Nc(t) 

d  (t)  =  Nd  ( t) 

This  shows  that  the  diffusion  approximation  results  in  the 
same  approximations  for  the  means  as  the  deterministic  model. 


db  ( t) 
dt 


dc  (t) 
dt 


dd(t) 

dt 


186 


b.  Stochastic  Equations 


The  terms  of  order  N  yield: 


dX]_(t)  =  {-0d(t)X1(t)+aBX2(t)-eb(t)X3(t)}dt 


+  /oigC  (t)  dW^  (t)  -  /SB  (t)d(t)  dV^  (t) 


d^it)  =  {8d(t)X1(t)  -  (^+0^5X2 (t)  +  0b (t)X3(t)}dt 

-  / (aB+aD)c(t)  dW3(t)  +  /§BTty5TtT  dW2(t) 

dX3(t)  =  {-0d(t)X1(t)+aDX2(t)-0b(t)X3(t)}dt 

-  /otpC  (t)  dW^  (t)  +  /SB  (t)d  (t)  dW3  (t) 


To  write  (4.23)  in  a  matrix  form, 


XT(t)  =  (x1(t)  ,x2(t)  ,X3(t)]  , 


and 


-*T 

W 


(t)  =  [w1(t)#w2(t)j 


Then,  (4.23)  becomes: 
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dX(t) 


-9d(t) 

“b 

9d(t) 

~{aB+aD) 

-9d(t) 

-9b (t) 

eb(t) 

-6b  (t) 


X(t)  dt 


+ 


/aBc (t) 

-/ (otg+a^ctt) 
/o^c  (t) 


-/Bfe(t)a(t) 

/&B(t)d(t) 

/0B(t)a(t) 


dw(t) 


which  appears  in  the  form: 


dX(t)  =  A (t )  X (t) dt  +  V ( t)  dW  (t ) 


(4.24) 


where  A(t)  (a  3  x 3  matrix)  being  identified  as  the  coefficient 
of  (X^ (t) ,X2 (t) ,X^ (t) ) T,  and  V(t)  (a  3  x2  matrix)  identi¬ 
fied  as  the  coefficient  of  the  Wiener  process  term. 

Now,  since  X(0)  =  3,  and  b(0),  c(0)  and  d(0)  are 
given  by  (4.21),  then  by  appealing  to  the  central  limit 
theorem,  for  all  t  >  0,  [Xx (t) ,X2 (t) ,X3 (t) ]  has  a  trivariate 

•  •  •  “V 

normal  distribution  with  mean  0  and  variance-covariance 
matrix  Z (t)  which  satisfies  the  following  differential 
equation;  Arnold  (1974): 

jr  I(t)  =  A ( t ) Z ( t )  +  I(t)AT(t)  +  V ( t ) VT ( t )  (4.25) 
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\v 


Recall  that 


B  (t) 

b  (t ) 

xx(t) 

C  (t) 

=  N 

c  (t) 

+  /N 

x2(t) 

D  ( t ) 

d  ( t ) 

x3  (t) 

-  - 

—  _ 

— __ 

Therefore,  we  have  obtained  the  following: 

RESULT  (4.2): 

{ B (t) ,C (t) ,D  (t) }  is  trivariate  normal  (Gaussian), 
as  N  (hence,  B(0)  +  D(Q))  -+  =°;  where  B(0)  and  D(0)  -*■  °° 
simultaneously  and  at  a  fixed  proportion: 

(B(t)  ,C(t)  ,D(t)  }  =  Normal  (N(b  (t),c  (t),d  (t)  )  ,NZ  (t)  ) 

From  Result  (2.1),  it  is  possible  to  estimate 
the  probability  that  at  least  a  specified  number  of  enemy 
bombers  are  free  at  time  t,  which  is  a  useful  measure  of 
effectiveness  (MOE) . 

The  deterministic  equations  (4.22)  and  the  equa¬ 
tion  (4.25)  for  the  covariance  matrix  E  (t)  can  be  solved 
by  numerical  integration. 

By  the  required  substitution  and  multiplication 


I 

I 

I 

§ 

ii: 

5 


7 

•* 

A 

I*' 


a  c(t)+0b(t)d(t)  -/ogCog+c^JcCt)  ~^^c(t) 


V(t)V  (t)  = 


WVc(t) 

■0b(t)d(t) 

^DC(t) 

-9b(t)d(t) 


-0b(t)d(t) 

^otB+aD^C(t) 

+6b(t)d(t) 


-6b(t)d(t) 

/aD(aB+Op)c  tt) 

+0b(t)d(t) 


/aD(aB+aD)c(t)  c^c  (t) 
+0b(t)d(t)  +0b(t)d(t) 


Writing : 


11 (t) 

°12  ^ 

°13 (t) 

12  (t) 

°22 (t) 

°23 

13(t) 

°23  ^ 

°33lt) 

Equation  (4.25)  becomes: 

~  S  ( t )  =  G (t )  S(t)  +  H (t ) 

at 

with  initial  conditions: 

S(0)  =  3 

where 


(4.26) 


-*T 

S  (t) 


>u(t)  o12(t)  o13(t)  022  (t)  °2  3  ( t )  o33(t)) 


G(t)  is  shown  on  the  next  page  and  H(t)  is  shown  below. 


H  ( t ) 


ctgC  (t)  +6b  (t)  d  (t) 

-/aB  (aB+aD)  c(t)-6b(t)d(t) 
-/aBaDc(t)  -  6b(t)d(t) 
(aB+aD) c (t) +9b (t ) d  (t) 

/aD (aB+aD) c (t)+8b(t)d(t) 
aDc  (t)  +6b  (t)  d  (t) 


2 .  Diffusion  Model  for  the  I  Scenario 

Under  the  I  scenario  we  can  characterize  the  combat 
process  approximately  when  B(0)  and  D(0)  ■+  <x> ,  by 

treating  (B(t);  t  >  0}  as  a  diffusion  process. 

The  Ito  stochastic  differential  equation  is: 


-oDD(0)dt  -  /ojP  (0)  dW(t)  for  B(t)  >_  D(0) 
dB (t)  =  j  (4.27) 

-aDB(t)dt  -  ^BltT  dW(t)  for  B(t)  <  D(0) 

Equation  (4.27)  is  written  using  the  rationale  used 
for  BCD  scenario.  Let 

D ( 0 )  =  o  B  ( 0 )  (4.28) 


where : 


6  is  fixed 
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Consider  the  following  linear  transformation: 


|  B(t)  =  B (0) b (t)  +  /B(0)  X  ( t) 

i 


' 

t  Differentiating  (4.29),  we  obtain: 


d£(t)  =  B  (0)db (t)  +  /B(0)  dX (t) 


(4.29) 


(4.30) 


Substituting  (4 . 28) - (4 . 30)  into  (4.27),  we  obtain: 


-aD6B(0)dt-/ccD6B(0)  dW(t) 

!if  B(0)b(t)-)ViToTx(t)  >  D(0)  =  6B(0) 

(4.31) 

-0^ [B  (0 ) b  ( t)  +^b!oTx ( t)  ] at-yj  ^^(ojbw+v^ToTxajidw ( t ) 
if  B(0)b(t)+®(t)  <  D(0)  =  6B(0) 


Isolating  terms  of  order  B(0)  and  /B(0),  and  letting 
B(0)  -*■  we  obtain  the  following  sets  of  equations, 
a.  Deterministic  Equations 

The  terms  of  order  B(0)  yield: 


db  (t) 
dt 


-aD6  if  b  (t)  >_  6 
-aDb(t)  if  b(t)  <  6 


(4.32) 


193 


Let  t* 


inf{t:  t  >  0  and  b(t)  <  6},  from  equa¬ 


tion  (4.32),  it  follows  that: 


-a^S 


db(t) 

dt 


.  (  D 


t  <  t* 


(4.33) 


-aDb(t)  if 


t  >  t* 


Suppose  X(0)  =  0,  then  from  equation  (4.29),  we 


obtain  the  following  initial  condition: 


b  (0)  =  1 


(4.34) 


For  t  <  t*. 


db(t) 

dt 


-aD6' 


therefore  using  (4.34),  we  obtain: 


b(t)  =  1  -  ctpSt  for  t  <_  t* 


(4.35) 


For  t  >  t*,  we  have,  from  equation  (4.33) 


db  (t) 
dt 


-aDb (t ) 


j  at, 

^{e  D  b(t)  }  =  0 


.  y * -v  W 


Hence : 


aD^~  ~  *  aD^* 

e  b(t)  -  b(t)e  =  0  for  t  >  t* 


From  equation  (4.48), 


b  (t*)  =  1  -  aD6t* 


Substituting  into  equation  (4.36),  we  get: 


b(t)  = 


.  ( 


1-aD^t 


(l-aD6t*)  e 


-aD(t-t*) 


for  t  <  t1 


for  t  >  ti 


but  from  the  definition  of  t* ,  we  have: 


b(t)  -  6 


substituting  into  (4.37),  we  get: 


b  (t*)  =  1  -  aD6t* 


-  6 


Hence : 


t*  - 


1-6 

aD6 
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(4.36) 


(4.37) 


(4.38) 


b.  Stochastic  Equations 


dX  (t ) 


The  terms  of  order  /B(0)  yield: 

/  -/aD6  dW{t)  for  t  '<_  t* 

I  (4.39) 

(  -ctpX  (t)  dt-/aDB  ( t)  dW(t)  for  t  >  t* 


For  t  £  t*,  from  equation  (4.39),  we  get: 


dX  ( t)  =  -  /ctD6  dW  (t) 

Integrating  both  sides,  we  get: 


X  ( t )  -  X(0)  =  -/o^6[W(t)  -  W(0)J  (4.40) 

Taking  the  expectation  of  both  sides  of  equation  (4.40),  we 
obtain : 


E [X ( t) ]  =  0 

Taking  the  variance  of  both  sides  of  equation  (4.40),  we 
obtain: 


-  a 


D 


6t 


Var (X(t) ) 


Hence,  for  t  £  t*,  X(t)  is  normally  distributed  with  zero 


mean  and  variance  c*D6t. 


For  t  >  t*,  from  equations  (4.37)  and  (4.39),  we 


get : 


f  -a_ (t-t*) 

dX(t)  =  -aDX(t)dt  -  yl e  dW(t) 


a  “n1 

^{e  D  X ( t)  }  = 


/ _a,n 

-e  VaD(1~aD<St*)e 


(t-t*) 


dW  ( t) 


■(t+t*) 


=  -/aD (l-aD5t*)  e 


dW  ( t ) 


Integrating  both  sides  we  get: 


aDt  “d1* 

e  X (t) -e  X(t*)  = 


-/aD(l-aD6t*)  e 


* 

JLt 

2  ^ 


aD 

t  -5-  T 

x  /  e  dW(x) 
t* 


Thus , 


-a_ (t-t*) 


X(t)  =  e 


X(t*)  -  /aD (l-aD6t*)  e 


t  —y  T 

x  (  e  dW ( t ) 


(4 


41) 


Since  the  function  e 


is  a  deterministic  func- 


,»’jV 

!»«•» 

■»'» 


*  •«. 


ft. 


■ftj 

,yj 

>»y» 

s& 


1 


1 


| 

I 

<♦»* 

•«y* 

**> 


tion  then  it  is  a  nonanticipating  function.  The  function 
g(s)  is  said  to  be  a  nonanticipating  function  if,  for  each 
s,  g(s)  is  independent  of  {W(t)  -W(s);  t  >_  s};  where  W(t) 
is  a  Wiener  process  with  mean  zero,  and  variance  t.  That 
is,  g(s)  is  independent  of  the  future  increments  of  the 
Wiener  process  after  time  s;  Schuss  (1980,  p.  63).  Hence, 
the  integral 


J  e  *  dW  (x ) 


is  a  stochastic  integral  (Arnold,  1974)  and  is  a  nonantici¬ 
pating  function  (Schuss,  1980). 

Now,  by  appealing  to  theorem  (4.4.2)  in  Arnold 
(1974) ,  we  obtain: 


E  [  /  e  dw(x )  ] 

t* 


(4.42) 


E  [{  / 

t* 


dW ( t ) }  ]  = 


(4.43) 


It  follows  from  equations  (4.42)  and  (4.43) 


that : 


aDt 


Var {  /  e  1  dW(r) } 

t* 


1,  01Dt  V1*, 
— ie  -  e  } 

aD 


(4.44) 


Taking  the  expectation  of  both  sides  of  equation 
(4.41)  and  using  equation  (4.42),  we  obtain: 


-an (t-t*) 

E  [X  ( t )  ]  =  e  E  [X  ( t * )  ] 


But  X  (t*)  ~  N(0,aD6t*).  Therefore  we  get 


E [X (t ) ]  =  0  for  t  >  t*. 

Taking  the  variance  of  both  sides  of  equation 
(4.41)  and  using  equation  (4.43),  we  obtain: 


t*)  -2(Xp(t  2^  ^  aD^* 

Var  (X(t) )  =  e  u  Var  (X(t*)  )+a-(l-ou5t*)e  ^  ~[e  u  -e  ] 

u  u 


-2cL(t-t*)  -cl  (t-t*)  -2cL(t-t*) 

aD6t*e  u  +(l-aD6t*)  [e  u  -e  u  ] 


Therefore,  for  t  >  t*,  we  have: 


-2a  (t-t*)  -a  (t-t*)  -a  (t-t*) 

X(t)  -  N{0,aD6t*e  +(l-aD<St*)e  (1-e  u  )} 
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We  can  summarize  the  above  calculations  as: 

RESULT  (4.3): 

As  B(0)  -*■  oo  (hence  D(0)  -*■  <»)  ,  B(t)  is  approxi¬ 
mately  normal  (Gaussian) . 

B(t)  =  N(B(0)b(t) ,B(0) Var (X  (t ) ) )  . 

This  result  can  be  easily  used  to  compute  leakage 
probabilities  in  terms  of  D(0). 

F.  A  MEASURE  OF  EFFECTIVENESS:  AN  APPROXIMATION 

The  diffusion  approximation  results  in  the  same  approxi¬ 
mations  for  the  process  means  as  those  given  by  the  solutions 
of  the  corresponding  deterministic  models  of  the  previous 
section.  It  has  been  shown  above  that,  in  addition  to  develop¬ 
ing  approximations  for  the  process  means,  we  are  able  to 
derive  expressions  for  approximating  the  variance-covariance 
matrix  of  each  process. 

Note  that  the  dimension  of  the  system  of  differential 
equations  resulting  from  the  diffusion  approximations  is  not 
a  function  of  the  initial  size  of  the  forces.  For  example, 
in  the  BCD  scenario,  we  need  to  solve  a  system  of  3  differen¬ 
tial  equations  to  solve  for  the  deterministic  means,  and  to 
solve  a  system  of  6  differential  equations  for  the  variance- 
covariance  matrix.  This  allows  military  analysts  to  economi¬ 
cally  model  combat  processes  for  larger  size  problems.  It 


also  allows  military  OR  analysts  to  derive  expressions  for 
approximating  (or  estimating)  probability  statements  that 
represent  measures  of  effectiveness  (MOE) ,  and  to  compute 
their  values  without  expenditure  of  excessive  computer  time. 
That  is,  a  useful  MOE  can  be  approximated  analytically,  and 
in  near  closed  form;  the  results  can  be  used  in  a  program  to 
optimize  logistics  allocations.  For  example,  suppose  that 
the  MOE,  as  stated  in  the  introduction  to  this  chapter,  is 
to  minimize  the  probability  of  penetration  of  at  least  z  free 
bombers.  It  is  assumed  that  bombers  are  not  capable  of 
delivering  their  load,  or  their  bombs  will  not  hit  targets 
defended,  when  they  are  being  engaged  by  defenders.  Define 
Tg  to  be  the  time  required  for  the  bombers  to  reach  the  bomb- 
release  line  (or  the  hand  over  line).  Then  B(Tg)  represents 
the  number  of  bombers  penetrating.  The  above  MOE  can  be 
evaluated  mathematically  by: 

P  i  B  (Tg)  >  z  |  B  (0)  ,D(0)  }  (4.45) 

where  the  conditional  distribution  of  { B (T  ) I B (0 ) , D ( 0 ) } 

D 

given  B(0),  D(0)  is  given  by  Result  (4.2)  or  Result  (4.3), 
depending  upon  the  scenario  under  consideration. 

The  diffusion  assumes  the  continuity  of  the  state  variables 
it  is  also  dn  asymptotic  approximation,  i.e.,  it  gives  good 
approximation  as  B(0)  and  D(0)  become  large  simultaneously. 

We  can  relax  these  assumptions,  and  evaluate  their  practical 


validity,  by  formulating  the  combat  process  as  a  continuous¬ 
time  discrete-state  Markov  process.  This  will  require  some 
other  assumptions  that  will  be  stated  in  the  next  section. 

G.  MARKOVIAN  COMBAT  MODELS 

Assume  that  the  engagement  time  between  a  defender  and  a 
bomber  is  Markovian  (i.e.,  has  an  exponential  distribution). 

That  is,  a  defender  takes  an  exponential  time  with  mean  c^1 
to  kill  a  bomber,  once  an  engagement  started;  and  that  a 
bomber  takes  an  exponential  time  with  mean  a-1  to  kill  a  defender 
Assume,  further,  that  the  defender  takes  an  exponential  amount 
of  time  with  mean  0  ^  to  detect  and  engage  a  free  bomber.  The 
air-to-air  combat  is  formulated  as  a  trivariate  continuous- 
time-Markov  process.  Recall  that  we  continue  to  assume  that 
bombers  are  arriving  simultaneously. 

1 .  BCD  Markovian  Combat  Model 

Under  the  BCD  scenario,  the  state  of  the  process  is 
represented  by  the  trivariate-Markov  process  {B (t)  ,C  (t)  ,D  (t) ; 
t  >_  0 }  operating  on  the  state  space  S;  where: 

S  =  {  (i,j  ,k)  :  0  £  i+j  _<  B;  0  £  j+k  <_  D;  0  <  i+j+k; 

i  =  0,1,..., B;  j  =  0,1,... ,min (B , D) ;  k  =  0,1,..., D}. 

During  a  small  interval  of  time  (t,t+dt],  the  state  changes 
occur  with  the  following  probabilities: 


t 


t+dt 


| 


<Sr. 


l\ 


■i 


Probability 


( i  ,  j  ,  k ) 


(i+1 , j-1 ,k) 


ffi(i,  j  ,.k)dt  +  o  (dt) 


(i-1, j+l,k-l)  fc(i,j,k)dt  +  o  (dt ) 


(i, j-l,k+l) 
(i, j ,k) 


f n ( i / j ,k)dt  +  o (dt) 


(4.45a) 


1  -  f(i,j,k)dt  +  o(dt) 


where  for  the  current  model 


fg (if  j /k)  =  aBj 


fc(i,j,k)  =  Qij 


(4.45b) 


f D ( i / j /k) 


=  V 


f (i , j , k)  =  f B ( i »  j / k)  +  fp (i, j ,k)  +  fn(i,j,k) 


Let , 


Pmn£-ijk(t)  =  P<B(t)  =  i,C(t)  =  j,D(t)  =  k | B ( 0 )  =  m, 


C  ( 0  )  =  n  ,  D  ( 0 )  =  l } 


In  what  follows,  for  simplicity  of  notation,  we  will 
suppress  the  initial  condition,  and  write: 


P  „  ■ -v (t) 

ran  V, ;  l  j  k 
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Apparently  {B  (t)  ,C  (t )  ,D  (t)  ;  t  >  0}  is  a  finite  state 


space  multivariate  death  process,  as  defined  by  (4.45). 

The  forward  Chapman-Kolmogorov  equations  are  derived 
by  writing  the  probability  that  the  process  is  in  state  (i,j,k) 
at  time  t+dt  as  a  function  of  the  state  probabilities  at  time 
t.  The  probability  of  being  in  state  (i,j,k)  at  time  t+dt 
is,  in  general,  expressed  by: 


P 


i,j,k 


(t+dt) 


+  fB(i'1'j+1'k)dtPi-l,j+l,k(t>  +fD(i'J+1'k-1)dtPi,j+l,k-l<t) 
+  o  (dt) ; 


the  terms  on  the  right-hand  side  express  the  mutually  exclu¬ 
sive  possibilities:  (i)  no  state  change,  (ii)  the  number  of 
combats  increase  by  one,  (iii)  a  bomber  wins  an  engagement, 
(iv)  a  defender  wins  an  engagement. 

Subtracting  P.  .  v(t)  from  both  sides  and  dividing  by 
dt,  and  letting  dt  tend  to  zero  results  in  the  following  sys¬ 
tem  of  differential  equations: 


dpi.i.k<t) 

dt 


-f(i,j,k)p.jjk(t)  +  fc<i+i,j-i,k+i)Pi+lij_lik+l<t) 


+  fB(i-l,j+l,k)Pi_1^+ljk(t) 


+  fD(i,j+l,k-l)Pijj+1(|t.1(t) 


(4.46) 
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Pi,j,0(t)  “f  (i,^,0)Pi/j,O(t)  +  fC(l+1^_1'1)Pi+l,j-l,l 


(t) 


+  fB(i-l, j+l,0)pi_1^ j+if0(t)  i»j  >  0  1  £  i+j  £  B 


Pi,j,k(t)  "f  (l,:i,k)Pi,j,k(t)  +  fC(l+1'j"1,k+1)Pi+l,j-l,k+l 


(t) 


fB(l_1,j+1,k)Pi-l,j+l,k(t)  +  fD^1,^+1,k-1^Pi, j+l,k-l 


(t) 


1  <  i  <  B-l  1  <  k<  D-l 

1  <  i+j  <  B-l  1  <  k+j  <  D-l 


(t) 


+  fBU“l#j+lrlOPi_lfj+1,k 


(t) 


(4.47) 
(Cont ’d) 


1  £  i  £  B-l  1  £  k  <_  D-l 
i+j  =  B  1  £  j+k  ^  D-l 


Pl,j,k(t)  "  “f  (l,:j'k)Pi,j,k(t)  +  fc(l+1'^_1,k+1)Pi+l,j-l,k+l 


(t) 


+  Vio+l.k-DP^^ 


(t) 


1  £  i  £  B-l  1  £  k  £  D-l 

1  <  i+j  <  B-l  j+k  =  D 


pio,k(t>  - 


*f C ( 1+1 ' j -1 ' k+1 } Pi+i , j -1 , k+1 


(t) 


1  £  i  £  B-l  1  £  k  £  D-l 
i+j  =  B  j+k  =  D 
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1  _<  j  <_  min(B,D) 


p;,o,k(t>  -  -£(i'°'wpi,o,k(t» +  ^(i-i.i,wpi.ifl(k<« 


(4.47) 
(Cont  *  d ) 


+  fD(i,l/k-l)Pi^1^k_1 (t) 


1  <  i  <  B-l  1  <  k  <  D-l 


P0,0,k(t)  =  fD(0,1,k'1)P0,l,k-l(t) 


1  <  k  <  D 


1  <  i  <  B 


P.  .  ,  (s)  be  the  Laplace  transform  for  P.  .  ,  (t), 

1  ,j  ,K 


then: 


Pi  i  k(s)  =  /  e  Pi  -i  k(t)dt  s  >  0 

X  t  J  f  *  Q  1  f  J  f  * 


Taking  the  Laplace  transform  for  PD  n  _,(t),  and  using 

D  ^  U  /  u 

the  initial  condition  B(0)  =  B,  C(0)  =  0,  and  D(0)  =  D,  we 
get,  from  (4.45)  : 


(  0-stp< 

J  e  fb,o,d 


( t) dt  = 


-f ( B , 0 , D)  J  e-s  PBf0fD(t)dt 


Using  integration  by  parts,  it  follows  that: 


-1  +  SPB,0,D(S>  -  -£ (B'°'D)Pb,0,D(S) 


Therefore : 


PB,0,D(s) 


s  +  f  (B ,  0  ,  D) 


Taking  the  Laplace  transform  for  the  general  form 


of  P.  .  .  (t)  in  (4.47),  we  get: 

1  t  J  f  * 


+  f(i,j,k>"'  fc  <1+1 . 3-1 . k+1  >  p1+l ,  j-1  ,k+l (s) 


+  £B(i-1'j+1’k»pi-i,j+a,kl 


+  fD(i,j+l,lc-l)Piij+l>)c.1(s)) 


(4.48) 


Therefore,  we  obtain  the  following  system  of  equations 
for  the  Laplace  transforms: 


PB,0,D(s) 


s  +  f(B,0,D) 


PB,0,k(s)  s+f(B,0,k){fB(B_1,1'k)PB-l,l,k(s)}  1  i  k  i  0-1 


(4.49) 


Pi,0,D(s) 


s+f  (i,0,D)  ifD(l,1,I>1)Pi,l,D-l(s)  }  1  -  1  -  B“1 


<  a.  <  o«  '  < 


0,j,k 


(s) 


s+f (0/j,k){fC(1,j‘1,k+1)Pi/j-l,k+l(s) 

+  fD(0^+1'k‘1)P0,j+l,k-l{s)} 

k,j  >  0  1  I  k+j  £  D 


=  { 


s+f (i, j, 0)  {fc(1+1/j_1»1)p 

+  fB(i-i,j+i,o)p._1<j+1>0 
i,j  >  0 


i+l,j-l,l(s) 
(s) } 

1  <  k+j  £  D 


i»  j/k 


(s)  = 


s+f (i,j ,k) L  C 


+  fB(i-l,j+l,k)Pi_1^+1^k(s) 

1  £  i  £  B-l  1  £  k  £  D-l 

1  £  i+j  £  B-l  1  £  k+j  £  D-l 


(4.49) 
(Cont 'd) 


pi,j,k(s' 


s+f (i,j,k){fc(i+1,j'1,lt+1)pi+l,j-l,k+l 


(s) 


+  fgCi-l/j+l/kJP^^^^fs) } 


1  £  i  £  B-l  1  <  k  £  D-l 
i+j  =  B  1  £  j+k  £  D-l 
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> 


i,j,k(s)  s+f  (i,j,k)  {fc(l+1,:i"1'k+1)Pi+l/j-l,k+l(s) 

+  ^(i#j+l#k-l)Pi#j+1^1(s)} 

1  <  i  <  B-l  1  <  k  <  D-l 
j+k  =  D  1  <  i+j  <  B-l 


Pi,j,k(s)  s+f  (i,j ,k)  {fC(l+1,:i"1'k+1)Pi+l, j-l,k+l 


(s) } 


1  £  i  £  B-l  1  £  k  £  D-l 
i+j  =  B  j+k  =  D 


(4.49) 
(Cont ’d) 


D) 


P0,j,0(s)  s+f(0,j,0){fC(1,j_1,1)Pl,j-l,l(s)}  1  £  j  £  min(B, 

Pi,0,k(s)  =  s+f(i,0,k){fB(l_1,1,k)Pi-l,l/k(s) 


+  fD(i,l,k-l)P^  ^  k-l^s^  1  £  i  £  B-l  1  £  k  £  D-l 


P0,0,k  ^ 


Pi,0,0(s) 


=  s^D(°,1,k-1)P0,l,k-l (s)  }  1ikiD 


i{fB(i-l'l'0)pi-1,1/0(s)}  liiiB 


Equations  (4.49)  are  in  a  form  that  is  suitable  for 
a  recursive  solution.  Solving  (4.49)  recursively,  we  get: 
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PB,0,D(s)  s+f  (B,0,D) 


PB-1,1,I>1(S) 


s+f  (B-l,l,I>l){fC(B,0'd)PB,0,D(s)  } 


PB, 0,0-1 (s)  s+f (B,0,D-1) {fB(B”1,1,D"1)PB-l,l/D-l(S) } 


PB-2,2,D-2(s)  s+f (B-2,2,D-2) {fC(B"1'1'D-1)PB-lfl,D-ll 


PB-1,0,D(S)  s+f(B-l,0,D){fD(B”1,1,D"1)PB-l,l,D-l(s) } 


PB-l,l,D-2 (s)  s+f (B-l/l,D-2){fC(B,0,D“1)PB,0,D-l(s) 


+  fB(B-2,2,D-25PB.2f2(I>.2(s)} 


PB-3,3,D-3(s)  s+f (B-3,3/D-3){fC(B_2'2,D-2)PB-2,2,D-2(s) } 


PB-2,1,D-1(S)  s+f (B-2,l,D-l){fC(B"1,0'D)PB-l,0,D{s) 


+  fD(B-2,2,I>2)PB_2f2fI>2(s)} 


PB,0,D-2(s)  s+f (B,0,D-2) {fB(B  1,1,D-2) PB-1,1 ,D-2 1 


PB-2,2,D-3(S)  s+f (B-2,2,D-3) ^fC(B  1,1 ,D-2) PB-1,1 ,D-2 * 
+  fB(B-3,3,D-3)PB_3^3^D_3(s) } 


(4.50) 


iOMMr- 


(4.50) 
(Cont 'd) 


+  fD(B-l,l,D-2)PB_1^1^I>2(s!  } 


PB-4,4,D-4(S) 


s+f (B-4,4,D-4) {fC(B_3,3,D~3)PB-3,3,I>3(s) ; 


PB-3,2,D-2(s)  s+f (B-3,2,D-2){fC(B"2'1,D_1)PB-2,l,D-l(s) 


+  fD(B-3f3,D-3)P^3>3fr>.3(s)} 


PB-2,0,D(s) 


s+f (B-2,0 ,D) ^fD(B~2'1,D_1)PB-2,l,D-l(s) 


Continuing  in  this  manner  we  can  solve  for  the  Laplace 
transforms  recursively  starting  from  state  (B,0,D). 

The  state  space,  S,  of  the  trivariate  Markov  process 
is  a  nonempty  set  of  states.  Define  the  set  of  edges  E  to 
be : 


E  =  (  {  (i,  j  ,k)  ,  (n,m,JU  ]  :  (i,j,k)  and  (n,m,£)  t:  S, 

and  (n,m,£)  is  accessible  from  (i,j,k)} 

Since  {B  (t)  ,C(t)  ,D  (t)  ;  t  >_  0 }  is  a  multivariate  pure  death 
process,  then  E  is  a  nonempty  set  of  edges.  The  edges  are 
ordered  pairs  [  (i , j ,k)  ,  (n,m, l) )  of  states.  The  state  <i,j,k) 
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is  called  the  tail  and  the  state  (n,m ,i)  is  called  the  head 
of  the  edge  [  ( i , j ,k) , (n ,m , l) ] .  Let  G  =  (S,E).  Then  G  is  a 
directed  graph.  For  a  definition  and  discussion  of  graphs 
see  Aho,  Hopcroft  and  Ullman  (1974).  Figure  (4.2)  illustrates 
the  graph  G.  Define  the  depth  of  a  state  (i,j,k)  in  G  to  be 
the  length  of  the  path  from  state  (B,Q,D)  to  state  (i,j,k), 
where  the  length  of  each  edge  is  1. 

The  set  of  equations  (4.50)  shows  that  by  knowing  the 

Laplace  transforms  of  the  states  at  the  nfc^  depth  of  the  graph, 

s  t 

then  the  Laplace  transforms  for  the  (n+1)  depth  can  be 
calculated  for  any  value  of  s.  With  this  observation  we  can 
solve  (4.49)  by  the  following  algorithm: 

1.  Construct  the  graph  of  the  process.  For  the  nfc^ 
depth  find  the  possible  states  and  calculate  its 
widtn,  i.e.,  how  many  states  are  in  the  nth  depth. 
Continue  until  the  width  of  the  depth  is  zero. 

.i" 

2.  For  the  n  depth,  if  width  (n)  ^  0  then  pick  a  state 
(say  (i, j ,k) ) .  Then: 

2.1  Calculate  the  meanof  the  corresponding  sojourn 
time.  ( (f (i, j ,k) ) -i) 

2.2  Examine  all  states  in  the  (n-l)st  depth,  to 
determine  which  states  are  accessible  to  state 
(i, j (k) . 

2.3  Calculate  the  corresponding  transition  rates 
from  the  state  determined  in  (2.2)  to  (i,j,k). 

2.4  Calculate  the  Laplace  transform  for  (i,j,k). 

Repeat  for  all  states  in  the  n^h  depth.  If 
width  (n)  =  0,  stop. 

Recall,  in  Chapter  III  we  derived  a  one-to-one  mapping 
between  the  multivariate  Markov-process  to  a  univariate  Markov 
process.  This  mapping  has  been  used  for  the  above  algorithm 


to  be  able  to  store  and  retrieve  the  states  and  their  corres¬ 


ponding  Laplace  transforms. 

The  solutions  for  equations  (4.50),  i.e.,  the  Laplace 
transforms  can  be  used  to  evaluate  some  measures  of  interest 
as  follows. 

Suppose  that  the  combat  duration,  Tg,  is  assumed  to 
be  a  random  variable  distributed  exponentially  with  mean 

r1.  Let, 

Pi,  j  ,k(TB)  =  15(13  (Tb)  =  i'C(TB>  =  =  klB(0)  =  B' 

C(0)  =  0,D(0)  =  D,Tb  } 

Following  the  argument  provided  for  evaluating  the 
readiness  of  the  squadron  at  the  time  of  attack  under  the  par¬ 
tial  surprise  scenario,  we  can  express  the  combat  outcome  in  terms 
of  a  Laplace  transform,  as  follows: 


EtPi,j,k(TB] 


/  P.  .  .  <uKe  ^udu 

0  i.J,* 


=  CPi,j,k(^ 


(4.51) 


The  probabilities  P.  .  ,(t)  can  be  determined  by 

1  r  1  t  K 

A 

inverting  the  Laplace  transforms  P.  .  ,  (s) ;  see  Gaver  (1966). 

if]  rK 

A  measure  of  interest  is  the  probability  of  eventual 
survivors . 


Let: 


It  follows  that: 


E[B(oo)  ] 


B  ( 0 ) 

I  iiT  .  (B) 
1=1 


B  ( 0 ) 

ifB(i-1,1'°)Pi-l,l,0  (0) 


(4.53) 


Equations  equivalent  to  (4.52)  and  (4.53)  can  be 
derived  for  the  defenders  by  following  similar  arguments. 

3 .  Markovian  Combat  Model  for  I  Scenario 

Under  the  I  scenario,  the  state  of  the  process  is 
given  by  {B(t);  t  >_  0  }  .  The  transition  probabilities 
the  process  {B(t);  t  >_  0}  of  order  dt  are  as  follows: 


t+dt 


Probability 


i-1 


fD(i)dt  +  o(dt) 


l-fD(i)dt  +  o(dt) 


(4.54) 


where  in  this  particular  case 


fD(i)  =  aD  min { i , D  (0 )  }  ; 


(4.55) 


Actually,  the 
for  arbitrary 
Let  D 
I  B  ( t )  ;  t  •  0  } 


remaining  results  hold 

f  D  (  i)  • 

D  ( 0 )  ,  and  B  -  B(0)  . 

defined  by  (4.54)  is  a 


quite  generally 

The  stochastic  process 
pure  death  process  with 
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state  space  {0,1,..., B};  see  e.g.,  Feller  (1971),  Chapter 
14.  The  parameters  of  the  process  are  given  by: 


f D ( i )  =  aDmin{i,D> 


|  iaQ  for  i  =  0,1,2, ... ,D-1 
\  DaD  for  i  =  D, . . . ,B 


(4.56 


Let : 


P.  .  (t)  =  P{B(t)  =  j  |  B  (0 )  =  i}  (4.57 

1  >  J 

For  simplicity  of  notation,  we  will  suppress  the 
initial  condition  for  the  moment,  and  write: 

P. (t)  2  P  .  (t) 

J  1  I  J 

The  forward  Chapman- Kolmogorov  equations  can  be 
derived,  as  in  the  BCD  case;  i.e.,  the  probability  of  being 
in  state  (j)  at  time  t+dt  is  expressed  by: 

P^t+dt)  =  (l-fD(j)dt)Pj(t)  +  fD(j+l)dtPj+1(t)  +  o(dt) 


It  follows  that, 


Therefore,  the  forward  Chapman  Kolmogorov  equations  are: 


P£(t)  =  fD(l)P1(t) 


Pj(t)  =  “fD(j)Pj(t)  +  fD(j  +  1)Pj  +  l(t)  1  1  j  1  B"1  (4.58) 


P^(t)  =  -£D(B)PB(t) 


with  initial  condition: 


Pj  (0) 


if  j  =  B 


otherwise 


Let  Pj(s)  be  the  Laplace  transform  for  P^ (t)  .  Then: 


P.  (s)  =  /  e  P. (t ) dt  s  >  0 

]  0  3 


Taking  the  Laplace  transforms  of  (4.58),  using  inte¬ 
gration  by  parts  and  applying  the  initial  condition,  we  obtain: 


pB(s) 


Pj  (s) 


P0(s) 


fD(B)+S 


[iyT¥{fD(j  +  l)Pj+1(s)}  1  <  j  <  B  (0 )  -1  (4.59) 


i{fD(1)Pl(s)} 


■men* 


I  Notice  that  (4.59)  is  already  in  a  recursive  form.  Starting 

t 

j  from  state  B ( 0 )  and  proceeding  recursively,  we  get: 


PB(S)  f D (B) +s 

1  fD(B) 

PB-1(S)  "  fD(B-l)+s(fD(B)+s) 

P  (S)  =  1  (  fP(B~1)  fP(B)  . 

B-2  fD(B-2)+s  lfD(B-l)+s  fD(B)+s) 

Continuing  this  way,  we  get: 


Pj  (s) 


fD( j)+s 


B 

n 

n= j  +  1 


fD<n> 

fD (n) +s 


Therefore,  the  solution  for  (4.59)  is  as  follows: 

Vs) 

Pj  (s) 


Note  that  the  term  f D (n ) / ( f Q (n) +s )  refers  to  the  Laplace 
transform  of  the  time  spent  in  state  (n) . 


1 

fD(B)+s 

1  B  fD(n) 

*  n=5+1  1  -  j  -  B'1 

.  1  ®  fDln) 

S  n=l  Vn)+S 
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a.  Evaluation  of  Measures  of  Effectiveness:  I 
Model 

A  useful  measure  of  effectiveness  is  to  compute 
the  probability  of  at  least  z  bombers  alive  at  time  T  (recall 
Td  is  assumed  to  be  deterministic)  in  terms  of  B(0)  and  in 

O 

particular,  D(0)  =  D.  The  latter  is  influenced  by  logistics 
considerations.  The  probability  of  interest  is: 

P{B(Tb  >  z|B{0)  ,  D  ( 0 )  } 

Note  that : 

B 

P{B(T  >  2 | B  (0 )  =  B ,D (0)  =  D}  =  £  P.  (Tg)  (4.61) 

j=z+l  3 

The  probabilities  P^ (t)  can  be  determined  by 

A 

inverting  the  Laplace  transforms  P^ (s) ,  see  Ross  (1983b) . 

Suppose  Tg  is  assumed  to  be  exponentially  dis¬ 
tributed  with  mean  E,  ^ .  Then  as  in  the  case  of  BCD,  we 
can  express  the  probability  of  interest  in  terms  of  the  Laplace 
transforms;  i.e.,  it  can  be  shown  that: 

B 

E [P { B (T  >  z | B  (0 )  =  B , D (0 )  =  D,TR}]  =  €  [  P^(C)  (4.62) 

B  B  j=z+l  3 
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If  we  continue  using  the  assumption  that  bombers 
being  engaged  by  defenders  are  considered  to  be  ineffective, 
then  a  measure  of  interest  is  to  compute  the  probability  of 
at  least  one  free  bomber  reaching  the  bomb  release  line.  Hence 
the  probability  of  interest  is:  P{B(Tn)  >  D  ( 0 )  j B ( 0 ) , D  (0 ) } . 

To  evaluate  this  probability  we  construct  an  equivalence 
relationship  with  the  sojourn  times  of  the  process  in  every 
state. 

Let  Xj ,  j  =  1 , 2  ,  .  . .  , B  ( 0 ) ,  be  the  sojourn  times 

for  {B  (t )  ;  t  >_  0}  in  state  j.  Therefore,  X^  ,  j  =  1,...,B, 

are  independent  random  variables,  each  with  an  exponential 

-fD(j)x 

distribution  F  (x)  =  1  -  e  that  has  a  rate  Da  for 

2\  •  L/ 

3 

j  =  D,D=1,...,B,  and  a  rate  jaQ  for  j  =  1,2,...,D-1. 

The  event  { B (T^)  >  D  (0)  | B (0)  =  B,D(0)  =  D}  is 
equivalent  to  the  event  that  the  B(t)  process  at  time  T0 
is  at  state  j  such  that  j  e  { D+l , D+2 , . . . , B} . 

Let  SD  be  the  waiting  time  until  there  are  exactly 
D  bombers  alive.  At  this  point  each  bomber  is  being  attacked 
by  a  defender  (according  to  the  present  model) .  Then 

S  =  l  X  (4.63) 

j=D+l  3 

Thus,  the  event  (B(T_)>  D  ( 0 )  |  B  ( 0 )  =  B,D(0)  =  D} 

D 

is  equivalent  to  the  event  {SD  >  Tg|B(0)  =  B,D(0)  =  D}.  But 
Sq  is  a  sum  of  i.i.d.  exponential  random  variables  with  rate 


a 


1 


»€ 5 

S 

ra 


1 


g 


:?l 


i 


I 

$ 


Da^ .  Therefore,  the  conditional  distribution  of  SD  given 
B(0)  =  B,  and  D(0)  =  D,  is  Gamma  (B-D,Da^). 

Hence : 


P(B(Tb)  >  DjB(O)  =  B,D(0)  =  D}  =  P{SD  >  Tg|B(0)  =  B,D(0)  =  D; 


r  (D“d,B"D  JMJ-1 

>  (B-D-l) l  t  e  dt 


Therefore,  we  obtain: 


P{B(T_)  >  D|B(0)  =  B,D(0)  =  D} 

D 


B-D  (Dc^t)11  1  -Da  t 

I  -7— vTi —  e  t  >  0 

(n-1) !  - 


(4.64) 


Another  measure  of  interest  is  to  compute  the 
expected  number  of  bombers  alive  at  time  t,  i.e.,  E[B(t)|B(0), 
D ( 0 ) ] .  To  simplify  the  notation,  we  will  temporarily  suppress 
the  initial  condition,  and  write: 


E  [B  ( t )  ]  =  E  [B  ( t )  |  B  ( 0  )  =  B  ,  D  ( 0 )  =  D] 


From  the  transition  probabilities  of  B(t)  of  order  dt  given 
by  (4.54),  we  get : 


B  (t+dt) 


B  ( t ) 


I  B  ( t )  -  1 


with  probability  l-fn(B(t))dt 


with  probability  f  (B(t))dt 


E  [B ( t+dt)  | B  (t)  ]  =  B ( t )  -  f  (B(t))dt 

Taking  expectation  of  both  sides,  we  get, 


E [B (t+dt) ]  =  E  [B  (t ) ]  -  E [f D (B ( t ) ) ] dt 


Subtracting  E[B(t)]  from  both  sides,  dividing  by  dt  and 
letting  dt  tend  to  zero,  gives:  . 


E '  [B (t ) ]  =  -E  £f D (B (t) )  ] 


B 

=  -  1  fD(j)Pi(t) 

j  =  0  D  3 


From  (4.55),  it  follows  that: 


D  B 

E'lB(t)]  =  -{  l  a  jP . (t)  +  l  anDP . (t) }  (4.65) 

j  =  0  U  3  j  =D+1  U  3 


B 

Adding  and  subtracting  £  ctnjP.  to  t^ie  right-hand  side 

j=D+l  °  3 

of  (4.65),  we  obtain: 


B 

E '  [  B ( t ) ]  =  -a  E  [B  (t) ]  +  an  £  (j-D)P.(t)  (4.66) 

D  D  j  =D+1  3 


From  (4.60),  we  have, 


B 


pj  (s) 


f  D  (n) 


fD(j)+S  n= j  +1  fD(n)+S 


D+l  <  j  <  B-l 


(Dot, 


B-j 


Pj(s) 


(DaD+s)B-:i  +  1 


D+l  <  j  <  B-l  (4.67) 


since 


f D ( j )  =  DaD  for  D  £  j  £  B. 


-1 


Let  L  { P . ( s ) }  denotes  the  inversion  of  P.(s), 


then : 


-1 


Pj  (t)  =  L  J-{Pj  (s)  } 


=  L 


-if  (DV 


B-j 


f(DaD+s)B  j+1 


Pj  (t) 


(DaD)B":  B-j  "DaDt 

t  J  e 


D+l  <  j  <  B 


(B-j)  ! 


Substituting  into  (4.78),  we  obtain: 


E'  [B ( t) ] 


(Da  t)B  j  -Da  t 

-anE[B(t)]  +  aD  [  (j-D)  - TTr-rr-r-  e 


B 


j  =D+ 1 


(B-j  )  ! 


Adding  a  E  [B ( t ) ]  to  both  sides  of  the  above  equation  and 

V 

multiplying  by  e  ,  we  obtain: 


» 

V 

b 


v* 


$ 

$ 

v: 


i 


ii*’ 

v,«: 

$ 


i 


•a 


j  at 

|^{e  D  E[B(t)  ]  } 


B  (Dar,t)B*j  -  ( D-l )  a_t 


Integrating  both  sides,  we  obtain: 


cx-.t  B  (j-D)  (DctJ6^11  t  -(D-l) a  x 

e  E[B(t)]-E(B(0)]  =  a  [  - st^ti -  /  T^ne  D  dx 

U  j=Dfl  o 


aDfc 

e  U  E[B(t)]-B 


?  i±mLlL  |i 

i=Dfl  (D-l)®"^1  ( 


-(D-l)aDt  B-j  (  (D-l)  a^t)  | 

5  Jo  *r- )' 


By  transforming  indices,  we  obtain: 


-at  -at  B-D 
E[B(t)  ]  =  Be  u  +  e  Y 


B-D- j  ((D-l)aDt)J 

1  +  Ji  F 


\  -OlX-Dt 
\  1  -  e 


B  >  D 


(4.68; 


Note  that  if  B  <  D,  we  obtain: 


-°‘Dt 


E  [B  ( t )  ]  =  Be 


When  the  combat  process  starts  with  B(0)  =  B  D, 

then  there  are  no  free  bombers.  Every  bomber  will  be 
engaged  by  a  defender. 


Wli* 


Def ine 


|  1  if  the  it^1  defender  is  engaging  a  bomber 
|  0  otherwise 


Then,  Y.(t),  i  =  are  i.i.d.  Bernoulli  random 

1  _aDt  B 
variables  with  probability  e  .  Therefore,  B(t)  =  J  Y. (t) 

-at  i=l  1 

is  a  binomial  random  variable  parameter  (B,e  ).  Hence, 


-at 

E  [B  ( t)  |  B  (0 )  =  B ,  D  ( 0 )  =  D]  =  Be  D  if  B  <_  D  (4.69) 


Note:  The  above  result  can  also  easily  be  found 

if  the  combat  times  of  individual  bombers  vs.  defenders  are 
arbitrary  but  i.i.d.,  denoted  Z: 


E  [B  ( t )  |  B  (0  )  =  B ,  D  ( 0  )  =  D]  =  BP  {  Z  >  t} 


We  summarize  the  above  in  the  following  result. 


RESULT  (4.4): 

The  expected  number  of  bombers  alive  at  time  t 
for  the  I  model  is  given  by: 
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X 


if  B  >  D 


E [B (t)  |B(0)=B,D(0)=D] 


Be 


"V 


|  B-D-j  ( (D-l)  o^t) 

(  k=l 


k! 


if  B  <  D 


H.  THE  LARGE-DEVIATIONS  APPROXIMATION  FOR  THE  I  MODEL 

The  large  deviations  technique  is  based  on  the  idea  of 
displacing  the  distribution  towards  a  value  of  interest, 
applying  the  central  limit  theorem  to  the  displaced  distri¬ 
bution,  and  re-displacing.  The  resulting  approximation  will 
better  estimate  the  behavior  of  the  distribution  at  the  value 
of  interest,  particularly  when  it  is  in  the  tail  (is  of  small 
probability).  For  an  exposition  and  some  useful  theory,  see 
Feller  (1971)  and  Esscher  (1932) ;  for  an  application  see 
Mazumdar  and  Gaver  (1984). 

As  noted  earlier  the  combat  process  is,  in  the  case  of 
the  I  model,  a  pure-death  process  that  starts  initially  from 
state  B.  The  pure  death  process  (B(t);  t  >_  0 }  operates 
on  the  state  space  { 0 , 1 , 2 , . . . , B  ( 0 )  }  .  Let  ,  j  =  0,1,.. .,B, 
denote  the  sojourn  times  for  {B(t);  t  >_  0 } ,  i.e.,  X^  measures 
the  duration  that  the  process  spends  in  state  j.  Therefore, 
X.,  j  =  0,1,..., B,  are  independent  random  variables  with  an 


exponential  distribution  F  (•)  that  has  a  rate  Da  for 

X  .  U 

j  =  D , D+l , ,B ,  and  a  rate  jaD  for  n  =  0,1,..., D-l. 

The  model  is  constructed  to  evaluate  P{B(t)  >  z|B(0)  =  B, 
D(0)  =  D}.  The  event  (B(t)  >  zjB(O)  =  B,D(0)  =  D}  is  equiva¬ 
lent  to  the  event  that  the  process  at  time  t  is  at  state  j 
such  that  j  i  { z+1 , z+2 , . . . ,B} .  Let  S2  be  the  waiting  time 
to  get  exactly  z  bombers  surviving.  Then  we  have: 


S 


z 


B 

J  X  .  0  £  z  <  B 

j  =  z+l  3 


(4.70) 


Thus  the  event  (B(t)  >  z|B(0)  =  B,D(0)  =  D}  is  equivalent 

to  the  event  {S  >  t | B ( 0 )  =  B,D(0)  =  D}.  It  follows  that: 
z 


P(B(t)  >  z  B (0)  =  B,D (0)  =  D}  =  P{Sz  >  t | B (0)  =  B,D(0)  =  D} 


B 

=  P {  l  X.  >  t  j  B ( 0 )  =  B , D ( 0 )  =  D} 
j=z+l  3 


Note  that  the  case  B  £  D  is  a  special  case  of  a  more 
general  case  where  B  >  D.  Therefore,  in  what  is  to  follow, 
we  will  assume  that  B  >  D. 

Let : 


>x.<s) 


j  estF  (dt)  , 


X 


( 4 . 7 1 : 
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,■>.*»  1 


assumed  to  exist  for  real  s  >  0,  sQ  <  s  <0.  Since  the  random 
variables  X ^  for  j  =  D,D+l,...fB  are  i.i.d.  random  variables, 
then  they  have  the  same  moment  generating  function.  Let 
4>v(s)  be  such  a  function. 

A 

A 

Let  F_  (s)  be  the  moment  generatinq  function  of  S  .  To 
Sz  .  z 

simplify  the  notation  let  F(x)  =  F  (x)  and  F(s)  =  F  (s). 

Sz  Sz 

We  will  also  suppress  the  initial  condition.  Then 


F(s)  =  E  [e  ] 


Since  the  random  variables  X  are  independent,  we  get: 


F  (s )  =  (;x(s))B~D  ;  (s) 

j  =  z  + 1  j 


(4.72; 


Let  V  be  the  probability  distribution  associated  with 

2 

F ( • ) ,  with  mean  p  and  variance  *  where: 


V{dx}  = 


eSXF{ dx } 
F  (s) 


,  s  >  0 


(4.731 


Let  V(£)  be  the  moment  generating  function  of  V.  Then: 


v<5) 


j  e"XV{dxl 


( s  +  f, )  x  , 
e  '  F{ dx 


Therefore : 


v(C) 


F(g+s) 

F(S) 


>  0 ,  s  >  0 


(4.74) 


Substituting  equation  (4.72)  into  equation  (4.74),  we 


get : 


VU) 


I  ix^  +  S)  ^  B-L) 

V  Vs)  /  j 


D-l  'i,X.(5+S) 

n  — ^ 

£  >  0 

j=z+l  ^X,*8* 

J 

s  >  0 

(4.75! 


Let  K(5)  =  in  V ( C )  be  the  corresponding  cumulant  generating 

function.  Then, 


K(C)  =  (B-D)  (in  4>x  ( £+s )  -  in  <J>x(s)) 


+  l  (in  bx  (£+s)  -  in  $>x  (s)) 
j=z+l  j  j 


(4.761 


Differentiating  equation  (4.76)  with  respect  to  t, ,  and 
evaluating  the  resulting  function  at  £  =  0,  we  get  the 
following  expression  for  the  mean  u(s) . 


(B-D) ; ’ (s) 

-vfr- 


D-l  :tX.(s) 

T—  1 

)  ^ - 

L  *  (  s  ) 

j  —  z  + 1  -X.  ' 

J  : 


(4.77) 


Differentiating  equation  (4.76)  twice  with  respect  to 
£,  and  evaluating  at  £  =  0,  we  get  the  following  expression 
for  the  variance: 


o  (s)  = 


(B-D){<Ms)4>"(s)-(<f>i(s))2}  d-1  ♦x.  (s)<!)X.(s)_(4)X. (s))” 

x  x  x  v  1  3 _ 3 


(<frx(s))‘ 


+  I 

j=z+l 


(4>x  (s))‘ 


(4.78) 


where : 


and 


Da. 


4>x  (s ) 


DaD-s 


s  >  0 


(4.79) 


*x.(s) 


3a 


D 


3aD-S 


s  ^  0  ,  j  —  0  r 1 » • • • r D-1 


(4.80) 


Da, 


K(s>  m 


(Dcijj-s) 


s  >  0 


(4.81) 


*x.(s) 

3 


3a 


D 


( j«D-s) 


s  >  0,  j  =  0,1,..., D-1  (4.82) 


2Da, 


*X(s)  = 


(DaD~s) 


s  >  0 


(4.83) 


*x.(s) 


2  ja. 


( jaD-s) 


s  >  0,  j  =  0,1,..., D-1  (4.84) 


Note  that  the  mean  and  variance  of  the  associated  dis¬ 
tribution,  equations  (4.77)  and  (4.78),  respectively,  are 


functions  of  s.  Therefore,  there  is  a  family  of  associated 


distributions  for  F  (•).  Let  y(s)  =  t  (i.e.,  center  the 

Sz 

associated  distribution  at  the  point  of  interest) ,  and  solve 
for  s.  Let  s  be  the  value  of  s  such  that  u(s)  =  t.  Thus, 
an  associated  distribution  V  has  been  determined.  Therefore, 
equation  (4.73)  becomes: 

V{dx}  =  eS!F~— X  -  -  s  >  0  (4.85) 

F  (s) 


with : 


mean  =  y  (s)  =  t 


and 


variance 


a2  (s) 


Thus  : 


F{dx}  =  F(s)e  sXV{dx} 


(4.86) 


and 

00 

P{SZ  >  t}  =  /  F {dx } 


Substituting,  we  get: 
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(4.87) 


P{Sz  >  t}  =  F ( s )  /  e_SXV{dx} 

Invoke  a  normal  approximation  to  V;  this  is  justified 
if  the  sum  belongs  to  the  domain  of  attraction  of  the  normal 
distribution  according  to  the  central  limit  theorem.  Cer¬ 
tainly  the  initial  B-D  components  are  i.i.d.  and  have  a 
second  moment  by  assumption,  and  hence  the  CLT  does  apply 
to  their  sum.  Provided  z  is  not  too  small  (e.g.,  if 
z  =  kB(0),  k  fixed),  then  the  remaining  terms  are  also 
well  behaved,  and  the  normal  approximation  should  be  adequate. 

Therefore,  it  follows  that 


P(SZ  5  tf  -  PLD(Sz  >  tl  E  F 


- (x-u (s) ) 

•N.  OO  2  ~ 

(S)  -i-  -/  e"sxe  20  (s) 


/2tT  y  (s) 


o(s) 


By  standard  substitution,  w  =  x  ,  we  obtain: 

J  o(s) 


w 


VSZ  > 


F  (s)  -i-  /  e-B(u(s)-wo(s))e  2  ^ 

fh r  o 


'2  2  ~  ~2  2  ~ 

Multiplying  the  right-hand  side  by  eS  0  S  s  0  S  ,  to 
complete  the  square,  we  get: 


PLD(SZ  >  U 


-  ~  i~2  2  ~  i  -  ~  2 

~  ~  -sy(s)+2S  a  (s)  00  -  j(w+so  (s) ) 

F(s)e  /  e  dw 

0 
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Let  x  =  w  +  so (s) . 


From  the  above  equation,  we  obtain: 


1~2  2  ' 

„  ~  -sy(s)+~sc  (s)  ,  »  2n 

PT n{ S  >  t}  =  F(s)e  z  —  -  -/  e  x  dx 

m  2  /ar  so  (s) 


(4.88) 


Using  equations  (4.72)  and  (4.79)  to  (4.82),  we  obtain: 


F  ( s )  = 


/  DaD  \  B_D  /  D:1  jaD  \ 

lDaD-§j  Uz+i 


Since  y(s)  =  t,  equation  (4.88)  becomes: 


PU><Sz  >  t} 


1~2  2  ~ 

Dip,  \  B-D  f  D-l  jan  \  -st  +  ~s  o  (s)  ~ 

e  (l-4>  (so  (s) ) ) 


V  _^D_\ 

Ij-s+lV8/ 


(4.89) 


where : 


$(x)  is  the  standard  normal  probability  distribution 
function,  and 


2,  x  B-D  D”1  1 

c  (s)  =  - 7  t  +  I  - 


T  l  — 

(DaD~s)  j=z+l  (jaD-s) 


and  s  is  the  appropriate  solution  of: 


-B-P-  +  °J1  — — -  =  t 

DaD-s  j=z+l  jaQ-s 


(4.90) 
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To  solve  for  s,  we  note  that  s  >  0  since  it  is  the  trans¬ 


form  variable  for  the  moment  generating  function.  We  also 


note  that  in  order  to  have  P{SZ  >  t}  ^0,  we  must  have 

jaD 

7-— g  >  0  for  every  j  =  z+l,...,D-l.  Hence,  s  <  (z+l)an. 


ja-s 


Therefore  we  obtain  the  following  condition  on  s: 


0  <  s  <  (z+l)a. 


(4.91) 


Define : 


=  4_ 

Tirv  ^  t  m 


j=Z+l  3°D 


Hence,  if  t  >  t*,  then  s  >  0.  We  now  need  to  determine  if 


for  all  values  of  t  >  t*  there  will  always  exist  a  0  <  s  <  (z+l)a. 


such  that  equation  (4.90)  is  true. 


Define : 


f  (s) 


R-n  D_1 
+  V 

DaD_S  i=z+ 


j=z+l  ^D-3 


The  function  f(s)  is  a  piece-wise  continuous  (differen¬ 


tiable)  function  with  points  of  discontinuity  s  =  ja  , 

D 


j  =  z+1 , . . . , D .  Differentiating  f(s)  over  the  ranges  of 


continuity  (differentiability),  we  get: 


f ' (s) 


B-D 


1 


D-l 

+  l 


(DaD~s)  j=z+l  (jaD-s) 


for  0  <  s  <  (z  +  1) 


and  for  jaD  <  s  <  (n+l)aD;  j  =  z+2,...,D. 

From  the  model  assumption  we  have  B  >  D.  Therefore 


f '  (s)  >_  0  V  0  <  s  <  (z  +  1)  ctjy*  jaQ  <  s  <  (j  +  l)aD 


Hence,  the  function  f{s)  is  a  piecewise  continuous  func¬ 
tion,  and  each  piece  is  a  monotonically  nondecreasing  function 
over  its  corresponding  range. 

Note  that  f  ( 0 )  <  0  for  t  >  t*,  and  f((z+l)a_)  =  °°  for 
any  t.  Thus,  by  imposing  the  condition  t  >  t*,  there  will 
always  exist  0  <  s  <  (z+l)aD  such  that  f(s)  =  0.  The  bisec¬ 
tion  method  (Gerald,  1984)  ,  was  implemented  to  determine  s 
numerically. 

Hence,  the  Large-Deviation  approximation  for  the  invul¬ 
nerable  combat  model  becomes: 


P{B(t)  >  z | B (0)  =  B,D (0)  =  D} 


1~2  2  ~ 

Dcl  \B-D,  D-l  ja  >  -st  +~s  a  (s) 
— —  /  n  - —\e 


-  /  r 

V  Dcu-s  /  \  j=z 


*  (1  -  <Mso(s))) 


where : 


yv*1  ■■■  *V>VV\ 


t  > 


B  >  D 


^  +  °j1  4- 

DaD  j=z+l  ^D 


2,  v  B-D  r  1 

o  (s)  =  - ^  +  l  - — 

(Da^-s )  j=z+l  (jaD~s) 


such  that : 


0  <  s  <  (z  +  l)a. 


+  °i1  -^-r  =  t 

DaD-s  j=z+l  jaD-s 


In  Appendix  A  we  derive  a  general  equation  for  the 
large  deviations  approximation  for  a  fixed  and  a  randomized 
sum  of  i.i.d.  random  variables,  together  with  some  applications 
to  other  logistics  problems. 


I.  SIMULATION  OF  BCD  MARKOVIAN  MODEL 

In  order  to  check  the  multivariate  diffusion  approxi¬ 
mations  for  the  BCD  model,  a  simulation  was  carried  out  by 
using  Monte-Carlo  methods  to  generate  a  realization  of  the 
air-to-air  combat  process,  which  is  modelled  as  a  trivariate- 
continuous-time  discrete-state  Markov  process.  Combat  data 
were  then  generated  to  compute  combat  statistics. 


The  Monte-Carlo  simulation  was  constructed  based  on  the 
following : 

a.  The  time  spent  by  the  process  at  state  (i,j,k)  is 
exponentially  distributed  with  rate  f(i,j,k).  If 
desired,  the  exponential  distribution  can  be  replaced 
by  an  arbitrary  distribution  function  to  obtain  a 
semi-Markov  model. 


Let  Xj_ 
Then : 

k  be  the  sojourn 

time  for  state 

(i, j , k) . 

(  1  -  e‘f(i^ 

,k)t,  t  >_  0 

1 

) 

(4.92) 

(  0 

,  t  <  0 

The  transition  probabilities 
chain  are  as  follows: 

for  the  embedded 

Markov 

Present 

Next 

Probability 

(i,j,k)  ->■ 

(i+l,j-l,k) 

fB(i, j »k) 
f (i/ j » k) 

-+ 

(i-1, j+l,k-l) 

fc (i, j ,k) 
f (i, j ,k) 

(4.93) 

-* 

(i , j-1 , k+1) 

f  D  ( i  ,  j  ,  k) 
f (i, j ,k) 

The  conditions  in  (a)  and  (b)  are  used,  together  with  a 
uniform  random  number  generator  that  produces  independent 
samples  of  a  random  variable  that  is  uniformly  distributed 
over  the  interal  (0,1),  so  as  to  generate  a  realization  of 
the  combat  process.  This  is  done  by  generating  two  independent 
samples  of  a  unit  uniform  variate,  denoted  by  and  • 
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U,  is  used  to  produce  a  realization  of  the  time  X.  .  .  , 

1 1  ]  , K 

time  spent  in  state  (i,j,k),  by  applying  the  inverse  trans¬ 
form  method,  as  follows: 


flXi,i,ki’,i,j,k1  =  !  .  e-f(i,j,k)x  .  „ 


then 


-f (i, j ,k) x . 


i,k  _ 


=  1  -  U  =  U, 


Therefore , 


-f (i, j ,k)x  .  ,  =  £n  U, 

1  ,  J  ,  K.  -L 


Thus,  we  obtain,  as  is  well-known , 

-  £n  U1 
Xi,j,k  -  f (i, j ,k) 


The  number  U 2  is  used  to  determine  which  state  the  process 
will  enter  next.  After  spending  x.  .  ,  units  of  time  in 

1  9  3  9  K 

state  (i,j,k),  the  process  will  next  transit  to: 


(i+1, j-l,k)  if 

(i-1, j+l,k-l)  if 


0  <  u2 


fB(i,j ,k) 
-  f (i,j,k) 


f  (i, j ,k)  f  (i,j,k)  +  f  (i,j,k) 

f  (i,  j  ,k)  u2  -  f  (i,  j  ,k) 


(4.95) 


(i, j-l,k+l) 


otherwise 


We  collect  statistics  for  the  process  by  discretizing 
the  time  domain.  Let  At  be  the  length  of  the  time  increments, 
and  T  be  the  length  of  time  for  the  simulation  of  the  process. 
T  could  be  the  time  for  bombers  to  be  in  region  from  detec¬ 
tion  to  hand-over  line.  Define  N  to  be  the  number  of  incre¬ 
ments  in  T.  Then: 


N  = 


At 


Construct  the  following: 

BB , BS  to  be  arrays  of  size  (N+l)  whose  entries  are 


M 


BB (n )  =  l  B  (n't)  ;  BS  (n 

L  -  m 


m=l 


M  2 
/  B  (nit) 

- .  m 
m=l 


CC,CS  to  be  arrays  of  size  (N+l)  whose  entries  are 


M 


CC  (n )  =  [ 


m=l 


Cm  (nit )  ;  CS  (n  ! 


M 


m=l 


c‘(n:.t) 

m 


DD,DS  to  be  arrays  of  size  (N+l)  whose  entries  are 


M 


DD ( n )  =  l 


m=l 


D  (n/.t)  ,  DS  (n) 
m 


M 


m=l 


D  (n't: 
m 


where : 


(Bm(nAt) ,Cm(nAt) ,Dm(nAt) ) 

is  a  (the  m^^1)  realization  of  the  state  of  the  process  at 

x. 

time  nAt  for  the  m  replication,  and  M  is  the  total  number 

of  replications. 

—  2 

Let  B (t)  and  S  (B(t))  be  the  sample  average  and  variance, 
respectively,  for  B(t).  Then: 

M 

l  B  (nAt) 

_ ,  m 

B  (nAt)  =  — —  -  n  =  0,1, ...,N  (4.96) 

M 

and 

M  (B  (nAt)-B  (nAt) ) 2 

S^  (B  (nAt).)  =  l  — ^ ^ -  n  =  0 , 1 ,  .  .  .  ,N  (4.97) 

m=l 

It  can  be  shown  that  the  above  are  unbiased  estimators 
for  the  process  mean  and  variance  (Larson,  1983). 

Equations  similar  to  (4.96)  and  (4.97)  can  be  constructed 
for  C (t) ,  and  D (t ) . 

J.  NUMERICAL  ILLUSTRATION  FOR  VARIOUS  COMBAT  MODELS 

This  section  presents  some  numerical  illustrations  for 
the  various  combat  models  presented  above.  The  illustra¬ 
tions  will  be  conducted  by  comparing  the  diffusion  approxima¬ 
tions  with  the  simulation  estimations  or  the  actual  parameters 


when  possible.  Therefore,  for  the  BCD  combat  model  we 
compare  the  diffusion  approximations  to  the  simulation 
estimations,  while  for  the  I  combat  models  we  compare  the 
diffusion  and  the  large  deviations  approximations  to  the 
actual  values. 

1.  An  Illustration  for  the  BCD  Combat  Model 


The  following  basic  data  were  used  as  an  example 
for  model  illustration: 


A  threat  of  B(0)  =  12  bombers  attacking  an  area  of 
responsibility  of  an  interceptor  squadron  that  is 
assigned  exactly  a  =  40  aircraft.  Therefore,  at  the 
time  of  attack,  the  interceptor  squadron  will  have 
D ( 0 )  aircraft  ready  to  engage  in  combat  where 
0  <  D ( 0 )  <  a. 


Each  interceptor  aircraft  (and  bomber)  is  assumed  to 
take  an  exponential  amount  of  time,  to  kill  its 
opponent  with  mean  (aB)-1  =  (.008)“!  seconds  (and 
(aB)“l  =  (.004)“^  seconds)  respectively. 


The  command  and  control  system  is  assumed  to  take 
an  exponential  amount  of  time,  with  mean  (9)_1  = 
(.006)-1  seconds,  to  detect  and  engage  a  free  bomber. 


FORTRAN  programs  were  written  for: 

1.  Computing  the  approximate  mean  and  variance  for  B(t) 
using  the  diffusion  approximation. 


2.  Simulating  the  discrete-state  Markovian  combat  process 
to  compute  the  mean,  and  variance  for  B(t).  The 
number  of  replications  M  =  10,000. 


For  illustration  purposes  the  following  values  for 


D(0)  were  considered: 


D ( 0 )  =  6,  12,  16,  20,  30,  and  40  . 

Figure  (4.3)  shows  plots  of  the  simulation  mean, 
and  the  deterministic  mean  resulting  from  the  diffusion  model 
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for  the  above  cases.  It  is  clear  from  the  plot  that  the 
diffusion  approximation  produces  a  good  approximation  for 
the  mean  of  the  process. 

Figure  (4.4)  shows  a  comparison  of  the  variance  func¬ 
tion  resulting  from  the  diffusion  model  with  the  variance 
function  resulting  from  simulating  the  Markovian  combat  proc¬ 
ess,  for  the  above  different  values  of  D(0).  The  figure 
shows  that  the  diffusion  approximation  provides  a  good 
approximation  to  the  variance  as  D(0)  increases.  Since  we 
are  assuming  an  increase  of  B(0)  +  D(0)  -+  °°,  where  B(0)  and 
D(0)  -*■  =0  simultaneously  and  at  a  fixed  proportion.  We 
therefore  consider  the  following  3  cases  (k  =  B(0)/D(0)  =  0.6). 


B  ( 0 ) 

D  ( 0 ) 

Case 

1: 

12 

20 

Case 

2: 

15 

25 

Case 

3  : 

18 

30 

Figure  (4.5)  shows  a  plot  of  the  resulting  vari¬ 
ance  functions  of  B(t)  for  the  above  cases  as  determined 
by  the  simulation  model  and  the  diffusion  approximation. 
The  figure  shows  that  the  variance  approximation  result¬ 
ing  from  the  diffusion  model  greatly  improves  as  B(0)  and 
D(0)  '*>  simultaneously  and  at  a  fixed  proportion.  Note 

that  the  diffusion  variance  is  systematically  larger  than 
the  simulation  variance,  but  the  discrepancy  is  reduced  as 
time  advances.  Since  it  is  probably  the  relatively  long 


0(0) -• 


0(0)  -  12 


Figure  4.4.  Plots  of  the  Variance  Approximation  Resulting 

from  Diffusion  Versus  Variance  from  Simulation, 
for  B ( t ) :  BCD  Scenario 


Figure  4.5.  A  comparison  of  the  Diffusion  and  S 
of  B(t)  as  Both  B<0)  and  D(0)  -*■  <*>  S 
and  in  a  Proportion  of  .6:  BCD  See 


times  (of  flight  of  the  bombers  towards  their  objective) 
that  is  of  interest,  the  discrepancy  may  not  be  serious, 
but  in  any  case  the  direction  of  the  difference  is  conser¬ 
vative:  The  diffusion  model  will  predict  greater  leakage 

of  bombers  than  does  the  (presumed)  more  exact  simulation. 
The  diffusion  computation  is  far  more  computationally 
economical-  Its  adoption  actually  permits  many  more  rapid 
calculations  than  would  use  of  simulation. 

2.  An  Illustration  for  the  Invulnerable  Combat  Model 


The  following  basic  data  were  used  as  an  example 
for  model  illustration: 

A  threat  of  B(0)  =  20  bombers  attacking  an  area  of 
responsibility  of  an  interceptor  squadron. 

The  squadron  has  exactly  D(0)  =  13  aircraft  operational 
and  ready  to  engage. 

Each  interceptor  aircraft  is  assumed  to  take  an 
exponential  amount  of  time  to  kill  a  bomber  with  mean 
(aD)"l  =  20  minutes. 

An  interceptor  aircraft  is  assumed  to  be  invulnerable, 
and  is  controlled  by  a  perfect  command  and  control 
system.  Therefore  the  time  taken  for  a  free  defender 
to  start  engaging  a  free  bomber  is  instantaneous,  i.e., 
equal  to  zero. 

The  intelligence  has  reported  that  the  enemy  tactical 
doctrine  dictates  that  the  raid  to  be  cancelled  if 
there  are  z  =  2  bombers  or  less  alive.  Hence,  we  are 
interested  in  evaluting  P{B(t)  >  2|B(0)  =  20,D(0)  =  13} 

FORTRAN  programs  were  written  for: 

1.  Computing  the  stochastic  mean,  stochastic  variance 

and  probabilities  using  the  Markov-process  formulation 

Computing  the  approximate  mean,  and  variance  using 
the  diffusion  approximation,  and  then  applying  the 
central  limit  theorem  to  compute  the  required 
probability . 


2. 


3.  Computing  the  approximate  probability  using  the  large- 
deviations  approximations. 

Figure  (4.6)  shows  a  plot  for  the  stochastic  mean 
compared  to  the  deterministic  mean.  We  find  that  the 
deterministic  mean  yields  a  good  approximation  for  the  sto¬ 
chastic  mean.  To  further  investigate  that,  a  plot  of  the 
stochastic  mean  versus  the  deterministic  mean,  and  a  plot 
of  the  difference  between  the  stochastic  mean  and  the  deter¬ 
ministic  mean  versus  time,  are  shown  in  Figure  (4.7).  It  is 
obvious  from  the  figure  that  the  two  means  form  a  45°  line 
when  plotted  against  each  other.  Figure  (4.7)  shows  that  the 
bias  between  the  2  means  tends  to  zero  as  t  -►  ».  The  bias 
is  defined  to  be  the  difference  between  the  stochastic  mean 
and  the  deterministic  mean. 

Bias  =  Stochastic  mean  -  Deterministic  mean 

Figure  (4.7)  also  shows  that  the  bias  is  always 
positive  and  tends  to  increase  from  zero  at  t  =  0  to  a 
maximum  bias  of  .167,  and  then  starts  to  decrease  to  zero  as 
t  -*■  oo.  This  shows  that  the  deterministic  mean  under¬ 
estimates  the  stochastic  mean  for  the  initial  stages  of 
combat . 

Figure  (4.8)  shows  a  plot  for  the  exact  variance 
compared  to  the  variance  resulting  from  the  diffusion  approxi¬ 
mation.  We  find  that  the  variance  obtained  by  diffusion  gives 
a  good  approximation  to  the  exact  variance.  Plots  of  the 
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igure  4.7.  Bias  of  the  Deterministic  Mean:  I  Scenario 
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stochastic  variance  versus  the  diffusion  variance,  and 
of  the  difference  between  both  variances  versus  time, 
are  shown  in  Figure  (4.9).  It  is  obvious  from  the  figure 
that  there  exists  some  bias  in  the  variance,  and  such  bias 
tends  to  disappear  as  t  In  this  case,  the  bias  is 

defined  to  be  the  difference  between  the  stochastic  variance 
and  the  diffusion  variance. 

Bias  =  Stochastic  Variance  -  Variance  by  Diffusion 

Since  there  exists  bias  in  both  the  mean  and 
variance  approximations,  we  expect  to  have  some  difference 
between  the  actual  probabilities  for  the  Markov  process 
and  the  probabilities  resulting  from  applying  the  normal 
approximation. 

Figure  (4.10)  shows  a  comparison  between  the  actual 
values  for  P{B(t)  >  2|B(0),D(0)}  as  a  result  of  applying  the 
Markov-process  model,  and  the  normal  approximation  values 
without  continuity  correction  using  the  diffusion  approxima¬ 
tion.  Figure  (4.11)  shows  the  same  comparison  as  Figure 
(4.10)  but  after  applying  the  continuity  correction  factor 
to  the  diffusion  approximation.  We  find  that  the  continuity 
correction  factor  has  improved  the  diffusion  approximation 
results . 

Figure  (4.12)  shows  a  comparison  between  the  actual 
values  of  PfB(t)  >  2|B(0),D(0)}  and  the  large  deviations 
approximation  at  large  values  of  t.  There  is  no  continuity 
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correction  for  the  large  deviations,  since  the  large  deviation 
equation  has  been  derived  for  a  sura  of  exponential  random 
variables.  Figure  (4.13)  shows  a  comparison  of  the  actual 
probability  and  the  diffusion  approximation  for  large  values 
of  t.  Comparing  Figures  (4.12)  and  (4.13),  we  find  that, 
for  large  values  of  t,  the  large  deviations  better  approximate 
the  actual  probability  than  the  diffusion  approximation. 

Figure  (4.14)  shows  a  plot  of  the  diffusion  approximation 
versus  the  actual  probability  for  large  values  of  t.  We 
find  that  the  resulting  curve  doesn't  form  a  45°  straight 
line.  Figure  (4.14)  also  shows  a  plot  of  the  relative  error 
over  time,  where 


relative  error 


Actual  -  Diffusion 
Actual 


We  find  that  the  error  tends  to  increase  steadily  until  it 
hits  a  100%  error,  a  100%  error  means  that  the  diffusion 
has  resulted  in  P{B(t)  >  2|B(0),D(0)}  =  0,  while  the  actual 
probability  is  not  yet  equal  to  zero. 

Figure  (4.  IS)  shows  a  plot  of  the  large  deviations 
approximation  versus  the  actual  probability.  We  find  that 
the  resulting  plot  forms  approximately  a  45°  straight  line, 
which  suggests  that  the  large  deviations  yield  a  good  approxi¬ 
mation  to  the  actual  probability.  Figure  (4.15)  also  shows 
a  plot  of  the  relative  error  over  time,  where  the  relative 
error,  in  this  case,  is  defined  as: 
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Relative  Error 


Actual  -  Large  Deviations 
Actual 

We  find  that  the  error  tends  to  increase  initially 
but  drops  to  zero  for  very  large  values  of  t.  This  suggests 
that  the  large  deviations  tend  to  give  a  better  approximation 
for  large  values  of  t  (i.e.,  for  values  that  are  in  the 
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A.  INTRODUCTION 

One  of  the  major  problems  an  air  force  faces  is  the 
determination  of  its  budget  allocation  when  a  new  weapon 
system  is  to  be  phased  in.  In  this  chapter,  the  term  "weapon 
system"  means  that  air  force  system  which  consists  of  the 
following : 

•  Aircraft. 

Spare  parts. 

•  Repair  facilities,  including  personnel. 

•  Early  warning  system. 

Other  components,  such  as  the  intelligence  system,  and 
the  communication,  command  and  control  (C3)  system  can  be 
considered  to  be  part  of  the  general  weapon  system  defined 
above.  For  example,  as  seen  in  the  operational  logistics 
models  constructed  in  Chapter  II,  the  effect  of  the  intelli¬ 
gence  system  is  considered  under  the  total  and  partial  surprise 

3 

scenarios.  The  C  system  effect  is  introduced  very  economically 
in  the  combat  models  under  the  BCD  scenario,  developed  in 
Chapter  IV,  which  is  represented  by  the  time  spent  to  detect 
and  engage  an  enemy  bomber.  The  early  warning  system  influ¬ 
ences  the  duration  of  the  combat  .  The  sooner  the  attack  is 
detected,  the  sooner  the  defenders  can  meet  and  engage  it 
before  it  reaches  the  handover  or  bomb  release  line. 
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The  outcome  of  combat  depends  upon  the  number  of  defenders 
ready  to  engage  at  the  time  of  attack,  D(0).  For  planning 
purposes,  D(0)  is  a  random  variabe;  its  distribution  has 
been  determined  in  Chapters  II  and  III  by  use  of  the  logis¬ 
tics  model. 

The  effectiveness  of  a  weapon  system,  WS,  must  be  evalu¬ 
ated  by  a  model  that  determines  the  readiness  of  WS  at  the 
time  of  attack,  and  then  computes  the  MOE  for  the  squadron. 

Hence,  we  need  a  model  that  is  capable  of  integrating  a 
logistics  model  with  a  combat  model.  Such  a  model  is  referred 
to  as  a  Combat-Logistics  model. 

In  formulating  combat-logistics  models,  the  type  of  air¬ 
craft  is  assumed  to  be  known  to  the  analyst.  In  reality  the 
analyst  may  wish  to  assess  the  effectiveness  of  different 
aircraft  types.  Mathematical  optimization  techniques  may 
finally  be  applied  to  the  combat-logistics  model  to  define 
the  optimal  weapon  system. 

B.  OBJECTIVES 

The  main  objective  of  this  chapter  is  to  determine  an 
optimal  weapon  system  for  an  interceptor  squadron  that  meets 
specified  mission  needs.  The  determination  takes  into  account 
budget,  combat,  and  logistics  constraints. 

To  determine  an  optimal  weapon  system.means  first  to 
identify  the  various  feasible  weapon  systems  that  are  avail¬ 
able  for  the  decision  maker,  considering  "real-life"  constraints, 
and  then  to  select  the  weapon  system  that  optimizes  the 


measure  of  effectiveness  of  the  interceptor  squadron.  In 
reality  it  may  be  best  to  present  the  decision  maker  with 
a  selection  among  a  few  systems  (a  short  menu)  along  with 
some  uncertainty  assessments  as  to  cost  and  performance. 

C.  SCOPE 

An  air-interceptor  squadron  is  selected  to  represent 
the  situation  under  study.  The  squadron  is  considered  to 
consist  entirely  of  the  same  type  of  interceptor  (or  fighter) 
aircraft.  The  decision  maker  has  a  budget  of  $K  for  procur¬ 
ing  the  weapon  system,  and  an  annual  budget  of  $K^/  to  be 
allocated  for  maintenance  facilities  (repairmen  or  crews, 
and  equipment) . 

This  study  concentrates  on  finding  the  optimal  way  of 
distributing  (allocating)  the  initial  budget  and  the  annual 
budget  among  the  different  components  of  the  weapon  system. 

Here  the  term  "optimal"  refers  generally  to  the  minimization 
of  the  probability  of  enemy  bomber's  penetration.  The  proba¬ 
bility  of  penetration  has  been  analyzed  in  the  previous 
chapter . 

D.  THE  MODEL'S  BASIC  CONCEPT 

1 .  General 

The  CL  model  assumes  a  small  or  middle-sized  air  force, 
represented  by  a  squadron,  defending  a  specific  area  of 
responsibility  against  a  known  enemy.  However,  the  mathemati¬ 
cal  modelling  is  more  general  and  can  be  applied  to  many 
different  situations  of  varying  force  size  and  composition. 
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2 .  Specific  Assumptions 

The  following  specific  assumptions  can  be  made: 

(i)  The  threat  can  be  assessed  far  into  the  future. 
The  number  of  enemy  bombers  attacking,  together 
with  their  capabilities,  can  be  predicted. 

(ii)  There  is  no  attrition  of  aircraft  and/or  modules 
during  non-combat  periods. 

(iii)  No  modules  leave  or  enter  the  logistics  system. 

(iv)  There  is  only  one  level  of  repair  (i.e.,  no  depot 
repair) . 

(v)  Immediate  replacement  of  flight-line  level. 

(vi)  Full  instantantous  cannibalization. 

(vii)  There  is  no  recruiting  or  attrition  of  repairmen 
(or  crews)  during  the  non-combat  periods. 

(viii)  There  is  no  support  from  any  of  the  neighboring 
country's  air  force  during  the  combat  periods. 


E .  APPROACH 

To  achieve  the  above  objectives,  the  combat-logistics 
process  of  the  squadron  has  to  be  analyzed.  The  combat- 
logistics  process  represents  the  combat,  non-combat  activities 
of  the  squadron.  The  effect  of  the  budget  allocation  supplies 
the  restrictions  for  determining  the  optimal  weapon  system. 
When  a  weapon  system  is  procured,  it  will  operate  under  a 
peacetime  environment  (non-combat  periods) ,  where  it  should 
be  managed  and  maintained  so  that  it  is  found  in  maximum 
readiness  when  called  upon  for  combat.  The  weapon  system 
then  performs  its  prime  objective  (conducts  combat) ,  so  as 
to  achieve  certain  combat  objectives,  as  measured  by  a 


suitable  MOE.  Therefore,  when  comparing  weapon  systems,  we 
need  to  evaluate  the  weapon  system  under  both  peace  and 
wartime  (combat  and  non-combat)  environments. 


WS  is  first  evaluated  during  non-combat  periods  by  the 
operational  logistics  models  discussed  in  Chapters  II  and 
III.  The  readiness  (availability)  of  aircraft  is  then  deter¬ 
mined  as  an  initial  condition  for  the  warning  model.  If  a 
total  surprise  scenario  is  considered  then  the  distributi  )n 
of  aircraft  readiness,  resulting  from  considering  the  limiting 
distribution  of  the  operational  logistics  model,  is  provided 
as  an  initial  condition  for  the  combat  model.  If  a  partial 
surprise  scenario  is  considered,  then  the  limiting  distribu¬ 
tion  of  the  operational  logistics  model  is  considered  to  be 
the  initial  condition  for  the  warning  model,  constructed 
in  Chapter  II.  The  warning  model  provides  the  distribution 
of  aircraft  readiness  at  time  of  attack.  This  is  used  as 
an  input  to  the  combat  model,  where  MOE ' s  are  then  evaluated. 

A  schematic  for  the  above  approach  is  shown  in  Figure  (5.1). 

The  combat-logistics  process  can  be  formulated  as  a 
mathematical  programming  problem.  The  constraints  for  the 
mathematical  program  are  divided  into  two  categories. 


1.  Budget  Constraints 


The  budget  constraints  are  subdivided  into  the 


following  two  categories: 


(a)  Fixed  budget  constraint:  This  represents  the 
total  budget  allocated  for  procuring  WS . 


Figure  5.1.  A  Schematic  for  a  Combat-Logistics  Model 
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(b)  Annual  budget  constraint:  This  represents  the  annual 
budget  allocated  for  the  squadron  to  operate  and 
maintain  WS . 


2.  Operational  Constraints 


These  represent  the  necessary  levels  for  the  various 
components  of  WS,  so  that  the  squadron  can  conduct  its  mission 


during  both  combat  and  non-combat  periods.  Note  that  the 
budget  constraints  may  be  incompatible  with  the  operational 
constraints  (requirements) . 
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F.  PROBLEM  FORMULATION 

We  now  consider  a  simplified  illustrative  representation 
of  the  problem  confronting  a  decision  maker.  Consider  an 
aircraft  squadron  that  is  assigned  a  budget  of  $K  to  procure 
WS.  WS  is  to  consist  of: 

1.  A  number,  a,  of  aircraft. 

2.  M^  and  M2  repairable  modules  of  Type  1  and  Type  2, 
respectively . 

3.  Rq  and  R2  repairmen  to  be  assigned  to  Shop  1  and 
Shop  2,  respectively. 

4.  An  early  warning  system. 

Suppose  the  squadron  is  allocated  $K-^  annually  as  a 
maintenance  budget  (or  annual  salaries  for  repairmen  (plus 
the  cost  of  necessary  equipment) . 

The  squadron  is  to  defend  the  area  against  a  prototypi¬ 
cal  threat  of  B(0)  enemy  bombers,  attacking  simultaneously 
a  number  of  national  and/or  military  targets.  The  squadron 
is  assigned  the  responsibility  of  minimizing  the  probability 
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of  the  enemy  bombers'  penetration  to  or  beyond  their  bomb 
release  line  (a  hand-over  line) .  Recall  the  following  com¬ 
bat  model.  Each  enemy  bomber  is  assumed,  when  engaged  by 
a  defender,  to  take  an  exponential  amount  of  time,  with 
mean  a  to  kill  a  defender  (if  unopposed) .  Each  defender 
is  assumed  to  take  an  exponential  amount  of  time,  with  mean 
0  to  detect  and  engage  a  free  bomber,  and  an  exponential 
amount  of  time,  with  mean  a^,  to  kill  a  bomber  (if  unopposed) 
once  engagement  starts;  the  combat  is  thus  modelleu  as  a 
competing  risk  problem.  It  is  assumed  that  only  one  free 
defender  can  engage  a  free  bomber,  and  that  the  engagement 
will  be  f ight-to-the-f inish . 

Let  A  denote  the  overall  Markovian  failure  rate  of  an 
individual  aircraft,  and  let  p1  denote  the  conditional  proba¬ 
bility  that  a  failure  requires  just  Type  1  (e.g.,  engines) 
repair,  p2  the  conditional  probability  that  the  failure  is 
of  Type  2  (e.g.,  avionics)  and  p12  the  conditional  probability 
that  both  Type-1  and  Type -2  failures  occur.  Thus,  Pi  +  P2  +  P 
=  1,  and  the  sequence  of  successive  failure  types  is  one  of 
independently  and  identically  distributed  random  variables. 
Finally,  it  is  assumed  that  repair  is  Markovian  (or  exponen¬ 
tial)  ,  where  only  one  repairman  can  work  on  a  failed  module, 
and  denotes  the  rate  at  which  an  individual  repair  of 
Type  i,  i  =  1,2,  is  completed  at  Shop  i.  Let  be  the 
number  of  repairmen  assigned  to  Shop  i,  i  =  1,2. 


Recall  that: 


X^(t),  i  =  1,2,  denotes  the  number  of  modules  of  Type  i, 
i  =  1,2,  that  are  in  or  require  repair  at  time  t. 

B(t)  denotes  the  number  of  free  bombers  at  time  t. 

C(t)  denotes  the  number  of  bombers  (hence  defenders)  in 

engagement  at  time  t. 

D(t)  denotes  the  number  of  free  defenders  at  time  t. 

As  shown  in  previous  chapters,  the  stochastic  process 
{ (t)  , X2  (t)  ;  t  >_  0 }  is  a  bivariate  birth  and  death  process; 
and  the  stochastic  process  {B  (t)  ,C  (t)  ,D  (t)  ;  t  >_  0}  is  a  tri¬ 
variate  pure  death  process,  defined  by  (2.16)  and  (4.45), 
respectively . 

It  was  shown  in  Chapter  IV  that  the  process 
{B  (t)  ,C  (t)  ,D  (t)  ;  t  ^  0}  can  be  approximated  by  the  trivariate 
diffusion  process  (B  (t)  ,C  (t)  ,D  (t)  ;  t  >_  0};  where  B(t),  C(t), 
and  D ( t)  is  the  continuous  approximation  for  B(t),  C(t),  and 
D ( t ) ,  respectively. 

G .  MODEL ' S  STRUCTURE 

1 .  The  Objective  Function 

The  objective  of  the  squadron  is  to  minimize  the 
probability  of  penetration  of  enemy  bombers.  The  probability 
of  more  than  z  free  bombers  reaching  their  bomb  release  line 
is  given  by  P{B(t)  >  zjB(O)};  this  can  be  obtained  by  blend¬ 
ing  the  combat  model  with  the  logistics  model.  From  the 
law  of  total  probability,  we  obtain: 
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P { B ( t )  >  z | B  (0)  } 


a 

=  l  P { B  ( t )  >  z  ,  D  ( 0 )  =  j  |  B  (0)  } 
j  =  0 

It  follows  that, 

a 

P{B(t)  >  z  |  B  (0 ) }  =  l  P(B  (t)  >  z  [  B  (0 )  ,D(0)  =  j}P{D(0)  =  j}  (5.1) 

j=0 

Let  y (B  (0)  ,D  (0) , t)  and  a2  (B  (0)  ,D  (0)  ,  t)  be  the  conditional 
mean  and  variance  of  the  marginal  process  {B(t);  t  0}, 
given  the  initial  force  levels.  From  Results  (4.2),  and 
(4.3),  we  find  that: 

B  ( t )  ~  N(u(B(0)  ,D(0)  ,t)  ;o2(B(0)  ,D(0)  ,t)) 

It  follows  that  P{B(t)  >  z | B  ( 0 )  =  B}  can  be  conveniently 
calculated  as  follows: 

a 

P{B(t)  >  z|B(0)  =  B}  -  l  P{B(t)  >  z|B(0)  =  B,D(0)  =  j}P{D(0)  =  j} 

j=0 


Thus , 


U  -  <(B,(jjitl))P<D(0)  * 


(5.2) 
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P{ B ( t )  >  z | B (0)  =  B}  -  1  -  l  4»{5=iil®4^-}P{D(0)  =  j} 

i=n  o(B,j,t) 


where : 


x  ,  2 

<Mx)  =  /  —  e  u  /2  du 

-oo  /2tT 


Hence,  the  objective  function  can  be  approximated  by. 


min 

WS 


*{2o(B?^t)>}P(D(0)  = 


or  equivalently  by: 


max 

WS 


J;(^(B?j^-r>p(DI0)  -  i\ 


(5.3) 


where  min [  ]  refers  to  the  act  of  minimizing  (maximizing) 

WS 

the  quantity  [  ],  subject  to  budget  constraints. 

To  evaluate  the  objective  function,  we  need,  for  every 
it  to: 

(a)  evaluate  the  term  ${- — ^ ^  1  using  one  of  the 

a  (B  ,  3  ,  t)  ^ 

diffusion  combat  models  constructed  in  Chapter  IV. 
Alternative  combat  representation  can  also  be 
utilized  as  required,  but  the  diffusion  model  renders 
computer  calculations  economical. 

(b)  evaluate  the  term  P(D(0)  =  j}  using  one  of  the 
operational  logistics  models  constructed  in  Chapters 
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II  and  III  for  a  range  of  logistics  assets  (spare 
parts,  repair  facilities)  that  is  within  budget 
constraints . 


(c)  select  the  optimal  combination  from  the  results  of 
(b)  . 

2.  Budget  Constraints 


H 

n 

■L 


a.  Fixed  Budget  Constraint 

A  major  constraint  when  a  weapon  system  is  to 
be  procured  is  the  amount  of  available  (or  planned)  budget. 
The  budget  is  thought  of,  in  this  study,  as  a  fixed  budget 
that  is  available  to  purchase  the  hardware  components  of  the 
weapon  system,  which  are: 
aircraft, 

modules  of  Type  i,  i  =  1,2,..., I 
early  warning  system 
where : 


I  =  number  of  different  types  of  modules 


Hence,  the  budget  must  be  equal  to  or  exceed 
the  summation  of  the  products  of  the  above  components  of 
WS  times  their  individual  cost  coefficients,  assuming  that 
linear  costs  are  appropriate;  otherwise  a  suitable  non¬ 
linear  cost  is  required.  Thus: 


I  N 

cna  +  y  c.M.  +  J  d  E  <  K 

0  . L,  ii  L .  n  n  — 

1=1  n=l 


(5.4) 


where : 


K($):  Total  amount  of  budget  available 


:  Number  of  Modules  of  Type  i 

En  :  Early  warning  system,  type  n 


co,c^,dn:  The  cost  coefficients  of  aircraft,  module 

1  1  type  i,  and  nth  early  warning  system 

respectively 

N  :  Number  of  different  types  of  early  warning 
systems  available  to  purchase. 

b.  Annual  Budget  Constraint 

The  annual  budget  considered,  for  this  study, 
is  the  annual  maintenance  budget.  This  is  represented  by 
considering  the  annual  running  cost  of  the  maintenance 
facilities  (e.g.,  annual  salaries  of  repairmen). 

Therefore,  the  planned  annual  budget  must  be 
equal  to  or  exceed  the  summation  of  the  products  of  the 
number  of  repairmen  (or  crews)  assigned  to  Shop  i  times 
their  individual  annual  salary  (or  cost).  Thus  we  obtain: 


I 


I 

i=l 


r  .R. 


1  l 


< 


K 


1 


where : 


=  The  annual  salary  for  an  individual  repair¬ 
man  assigned  to  Shop  i. 

3 .  Operational  Constraints 

In  order  for  the  interceptor  squadron  to  conduct 
training  programs  and  reconnaissance  missions  during  non¬ 
combat  periods,  and  to  be  able  to  cause  some  damage  to  enemy 
bombers  during  combat  periods,  the  number  of  aircraft,  a, 
must  have  a  positive  lower  bound.  The  lower  bound  of  a,  H  , 

cl 

should  be  at  least  2  aircraft  so  that  some  training  missions 

can  be  conducted.  However,  the  solution  strategy  for  our 

models  allows  different  values  of  Z  which  can  be  determined 

a 

by  the  decision  maker.  Therefore,  we  obtain  the  following 
condition : 

a  >  l  (5.6) 

—  cl 

Similarly,  lower  bounds  for  ,  i  =  1,2,...,  I,  can 
be  derived.  In  order  for  the  event  of  having  all  of  the 
aircraft  assigned  to  the  squadron  operational,  to  occur, 
we  must  have  the  following  condition: 

_>  a  i  =  1 , 2 ,  ...» I  (5.7) 

Since  the  modules  are  assumed  to  be  repairable,  then 
every  shop  should  be  assigned  at  least  one  repairman  (or 
crew) .  Of  course  our  model  implies  that  the  probability  of 
having  at  least  one  idle  repairman  at  Shop  i  is  one  if  >  NL  . 
Hence  we  obtain  the  obvious  constraint: 


1<_Ri<Mi,  i  =  1,2,...,  I  (5.8) 

In  a  more  detailed  model  several  crews  or  individuals  might 
work  simultaneously. 

Modules  that  are  operational,  and  not  installed 
on  any  aircraft,  are  stored  in  the  supply  depot.  This  results 
in  a  capacity  constraint;  for  planning  purposes,  this  can 
be  represented  by  the  decision  maker  specifying  a  certain 
coefficient,  p^,  for  determining  the  ratio  of  modules  of 
Type  i  to  aircraft,  where: 

M.  <  p.a  then  p.  e  [1,°°) 

1—1  1 

Considering  (5.7),  it  follows  that, 

a  <_  M.  £  P-ia  i  =  1,...,I  (5.9) 

It  is  assumed  that  only  one  early  warning  system 
is  to  be  purchased  for  the  air  defense  system.  This  can 
be  represented  by  the  following  constraint: 

N 

y  E  =  1  ,  and  E  is  binary,  n  =  1,...,N  (5.10) 

u .  n  n 

n=l 

Finally  the  WS,  WS*,  that  maximizes  the  objective 
function  and  satisfies  the  constraints  is  the  solution  of 
the  following  non-linear-integer-mathematical-programming 
problem. 
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mam 


max  l  ^TrB  i  tr}p{  {DQ) 

WS  j=0 


cna  +  y  c.M.  +  y  d  E  <  K 

0  .L,  11  L .  n  n  — 

1=1  n=l 


y  r  .R. 

i=l  1  1 


1  K1 


N 

I  E 


=  1 


>  a 


a  <  M.  <  p.a 

—  i  —  i 


i  *  1  / » •  .  / 1 


1  £  Ri  1  Mi 


i  = 


En  binary 


n  =  1 ,  .  .  .  ,  N 


a,  M^,  ,  i  =  are  positive  integers 


In  general  models  that  integrate  logistics  with 
combat  will  be  referred  to  as  combat-logistics  (CL)  models. 


H.  COMBAT  LOGISTICS  MODELS:  SIMPLE  ILLUSTRATIONS 

Suppose  there  are  two  early  warning  systems,  E^  and  E2 , 
available  for  purchasing.  Each  system  can  allow  a  different 
combat  duration.  The  term  "combat  duration,"  referred  to 
in  this  chapter,  is  the  length  of  time  required  for  the 
bombers  to  reach  their  bomb  release  line,  measured  from 
the  beginning  of  the  engagement. 

Let  t^  be  the  combat  period  achieved  by  deploying  E^ , 
and  t2  be  the  combat  period  achieved  by  deploying  E2 ;  t-^ 
and  t?  are  assumed  to  be  deterministic. 

Special  cases  of  the  above  combat-logistics  model  are 
the  Single-Module  Combat-Logistics  (1MCL)  and  the  Two- 
Module  Combat  Logistics  (2MCL)  models. 

1 .  Single-Module  Combat-Logistics  Model  (1MCL) 

Under  the  single-module  logistics  assumptions, 
stated  in  Chapter  II,  the  corresponding  combat  model  becomes 


1MCL : 


max  l  j— ^-p~}P{D  (0) 

WS  j  =  0 


=  j> 


s .  t . 


c^a  +  cM  +  d^E-^  +  d2E2  <_  K 
E1  +  E2  =1 


a 


> 


Z 


a 


a  <  M  <  pa 


E^ ,  E2  binary; 


a,  M  positive  integers. 


Note  in  the  present  1MCL  formulation  we  may  drop 
the  annual  budget  constraint  for  the  repairmen.  This  is 
because  it  is  assumed  that  there  is  only  one  shop.  There¬ 
fore,  the  number  of  repairmen,  R,  to  be  assigned  to  the 
repairshop  will  be: 


where  r  =  annual  salary  for  an  individual  repairman,  since 
the  above  salaries  are  the  only  component  of  annual  cost 
in  the  present  model. 

The  maximization  is  thus  over  the  specification  of 
WS,  where  we  abbreviate  the  latter  as 

WS  =  [a,  M,  E^ 

i.e.,  WS  is  represented  by  a  vector  whose  components  are 
the  number  of  aircraft,  a,  the  number  of  spare  modules,  M, 
and  the  particular  warning  system  selected,  .  If  E^  =  1 
then  the  first  early  warning  system  is  selected,  otherwise 
E^  =  0  which  indicates  that  the  second  early  warning  system 
is  selected. 

Availability  of  aircraft  is  a  nondecreasing  function 
of  the  number  of  modules  purchased  for  a  given  number  of 
aircraft.  That  is,  if  the  squadron  has  a  number,  a,  of 
aircraft  then  procuring  more  modules  will  tend  not  to  decrease 
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the  availability  of  aircraft.  The  above,  and  constraints 
of  1MCL ,  justify  the  following,  for  a  given  value  of  a: 


let  M  =  min{pa, 


K-dlEl-d2E2‘c0a 


1MCL  can  be  solved  iteratively  over  all  feasible 
values  of  a,  E^,  and  E.,;  while  choosing  M  to  be  as  given 
above . 

2 .  Two-Module  Combat-Logistics  Model  (2MCL) 

Under  the  two-module  lgistics  assumptions,  stated 
in  Chapter  II,  the  corresponding  combat  model  becomes: 


2MCL: 


max  l  }P { D  ( 0 ) 

WS  j  =  0  a(B^'t} 


=  j} 


s .  t . 


cQa  +  c^M^  +  c2M2  +  d-^E^  +  d2E2  —  K 


rlRl  +  r2R2 


1  K1 


E.  +  E-,  =  1 

1  z 


a  >  SL 

—  a 


a  £  1.  P]_a 


a  £  M2  —  p2a 


1  1  R1  ±  M1 


1  <  R2  i  M2 


E^ ,  E2  binary;  a,  M^ ,  M2 ,  ,  R^  are  positive  integers, 


In  this  case,  WS  is  specified  by  the  vector 


WS  =  [a,  M2,  R^  R2,  E^ 


In  the  k-module,  s-shop  case  the  WS  is  specified  by 
an  analogous  vector. 

As  in  the  case  of  the  1MCL,  for  a  given  a  and  , 
it  is  assumed  that  the  availability  of  aircraft  is  a  non¬ 
decreasing  function  of  M2 .  Also,  for  a  given  a,  ,  M2 ,  and 
R^ ,  we  assume  that  the  availability  of  aircraft  is  a  non¬ 
decreasing  function  of  R2 .  Therefore  for  a  given  value  of 
a,  and  R^ ,  let 


M 


2  =  min{p2a. 


K-d1E1-d2E2-c()a-d1M1 


}  , 


and  let 


R2  =  min{M2, 


KrriRi 
L  c2 


2MCL  can  now  be  solved  iteratively  over  all  feasible 
values  of  a,  ,  E^ ,  E2  and  R-^ ,  while  choosing  M2  and  R2 
as  given  above. 

I.  SPECIFIC  ILLUSTRATIONS 
1 .  General 

This  section  presents  illustrations  of  some  scenarios 
that  can  be  modelled  by  1MCL,  and  2MCL.  The  scenarios 


2  82 


considered  in  this  section  are  the  BCD,  and  the  I  combat 
models,  under  the  total  surprise  situation.  We  first  pre¬ 
sent  two  illustrations  of  the  1MCL  model.  one  uses  the  I 
model  for  the  combat  part  of  the  model,  and  the  other  uses 
the  BCD  model.  Then,  we  present  an  illustration  of  the  2MCL 
model  that  uses  the  I  combat  model. 

The  diffusion  models  constructed  in  Chapter  IV  are 
used  to  approximate  the  combat  process  under  both  the  I  and 
BCD  models.  The  single-module  logistics  model,  and  the 
two-module  logistics  model,  constructed  in  Chapter  II  are 
used  to  represent  the  logistics  system  required  for  WS . 

2 .  Model  Parameters :  1MCL 

The  following  parameters  are  used  for  model 
illustrations : 

(i)  Threat .  The  threat  considered  is  B(0)  =  12 
bombers  attacking  simultaneously.  We  have  not 
taken  into  account  the  possible  uncertainty  in 
identifying  the  threat  magnitude. 

(ii)  MQE .  The  decision  maker  is  interested  in  mini¬ 
mizing  the  probability  of  more  than  3  bombers 
penetrating,  or  reaching  their  bomb-release  line. 

(iii)  Logistics .  Each  aircraft  fails  at  a  rate  of 
X  =  0.5  aircraft  per  day. 

There  are  R  =  4  repair  crews  assigned  to  the 
squadron . 

Each  failed  module  is  repaired  at  rate  p  =  1.0 
modules  per  day,  where  only  one  repair  crew 
can  work  on  a  failed  module. 

There  is  enough  space  to  store  modules  when 
they  are  up  and  not  installed  on  aircraft; 
i.e.,  p  is  assumed  to  be  <=°. 

(iv)  Combat.  Each  defender  takes  an  exponential  amount 
of  time,  with  rate  of  aD  =  3  (bombers  per  hour), 
to  kill  a  bomber,  where  only  one  defender  can 
engage  a  free  bomber. 


For  the  I  model  the  defenders  are  invulnerable, 
i .  e  •  ,  cig  0 .  2 

For  the  BCD  model,  C  takes  an  exponential  amount 
of  time,  with  rate  0  =  Q.b  to  detect  and  engage 
a  free  bomber.  Each  bomber,  if  engaged,  takes 
an  exponential  amount  of  time  with  rate  a£  =  0.5 
(defenders  per  hour) ,  to  kill  a  defender. 

If  early  warning  system  E^  is  deployed  then  the 
combat  period  is  t]_  =  1.0  hour.  If  E2  is 
deployed  then  the  combat  period  is  t2  =  0.8  hour. 
The  lower  bound  for  the  number  of  aircraft,  £_, 
is  2  . 

(v)  Cost. 

-  The  squadron  has  been  allocated  a  budget  of 
K  =  $115  million  for  purchasing  the  WS. 

Each  aircraft  costs  Cq  =  $10  million. 

Each  module  costs  c  =  $2  million. 

The  Ei  costs  d]_  =  $15  million,  while  E2  costs 
d2  =  55  million. 

Using  the  above  parameters,  the  1MCL  becomes: 


max 

WS 


{z-u(12, j ,t) 
a  (12  ,  j  ,  t) 


}P{D  (0 ) 


s.  t. 


10a  +  2M  +  15E2  +  5E2  <_  115 

E1  +  e2  -  1 

a  -  M  >_  0 

a  >  2 


E^  binary  i  =  1,2 
a,  M  integer. 


This  model  was  solved  by  evaluating  all  feasible 


k.  ft  a  1  i 


Then,  if  is  deployed  then  •  1  and  t  =  t^ , 

otherwise  E2  is  deployed  and  t  =  t2  since  E^  =  0.  For  every 

2 

j,  y(12,j,t)  and  a  (12,j,t)  are  determined  using  Result 

(4.3)  for  the  I  model  and  Result  (4.2)  for  the  BCD  model; 

o 

where  y (  )  and  o  (  )  are  the  mean  function  and  the  variance 

function  of  the  {B(t);  t  >  0}  process  obtained  by  the  diffu¬ 
sion  approximations. 

3 .  1MCL  Using  I  Model 

Under  the  I  model  assumptions,  the  diffusion 
approximation  for  B(t)  is  given  by  Result  (4.3). 

For  every  combination  of  a  and  M,  P{D(0)  =  j}  was 
computed  using  equation  (2.8). 

Figure  (5.1)  shows  a  surface  plot  of  the  objective 
function  when  E^  =  1.  The  figure  indicates  that  if  E-^ 
is  selected  as  the  early  warning  system  to  be  deployed, 
then  the  optimal  WS  =  [6,  20,  1],  i.e.,  to  buy  6  aircraft, 
and  20  modules,  this  yields  an  objective  value  of  0.9903; 
i.e.,  a  probability  of  penetration  =  1  -  0.9903  =  0.0097. 

Figure  (5.2)  shows  a  surface  plot  of  the  objective 
function  when  E2  =  1,  which  indicates  that  the  optimal 
solution  will  be  to  buy  7  aircraft  and  20  modules,  and 
obtain  an  objective  value  of  .9211. 
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From  the  above,  it  is  concluded  that  the  optimal 
weapon  system,  WS*,  is: 

WS*  =  [6,  20,  1] 

i.e.,  buy  6  aircraft,  20  modules,  and  deploy  E, .  WS* 
under  the  single-module  logistics  and  the  I-combat  assump¬ 
tions  results  in  a  probability  of  penetration  of  0.0097. 
a.  Comparison  with  Exact  Computations 

If  a  =  6  aircraft  and  M  =  20  modules,  then  we 
get  the  following  readiness  distribution,  using  (4.8): 

j  =01  2  3  4  5  6 

P{D(0)  =  j}  =0  0.0002  0.0006  0.0017  0.0034  0.0054  0.9887 

If  we  calculate  p{B(l)  >_  3|B(0)  =  12,D(0)  =  j}, 
j  =  0,1,.. .,6,  using  the  Markovian  combat  model,  i.e.,  by 
solving  the  forward  Chapman-Kolmogorov  equations  (4.58) 
numerically,  we  obtain  the  following: 

j  =  0123456 

P{B(1)  <  3 | 

B(0)  =  12,D(0)  =  j  =  0  0.0004  0.1527  0.5444  0.7989  0.9590  0.9892 


Therefore : 


It  follows  that  by  solving  the  Chapraan-Kolmogorov 
equations  numerically  for  WS*  proposed  by  1MCL,  we  obtain 
a  probability  of  penetration  of  0.0120.  This  yields  a 
relative  error  of: 


.0097  -  .0120 

.012 


0.19  , 


i.e.,  a  relative  error  of  about  20%  is  obtained.  This  indi¬ 
cates  that  the  diffusion  is  overly  optimistic.  But,  the 
order  of  magnitude  seems  adequate,  even  though  the  numbers 
are  small. 

4 .  1MCL  Using  BCD  Model 

When  the  BCD  combat  model  was  used  with  the  param¬ 
eters  given  earlier  (i.e.,  aD=  3,  afi  =  .5,  0  =  .6),  1MCL 
gave:  WS*  =  [7  15  1] ;  with  an  objective  value  of  0.5288, 
i.e.,  probability  of  penetration  =  0.4712.  If  early  warning 
system  E2#  which  has  shorter  detection  range  than  , 
is  procured  the  corresponding  optimal  WS  =  [7  20  0] , 

with  an  objective  value  of  0.4686.  This  shows  that,  for 
the  current  example,  procuring  E^  results  in  a  better 
combat  effectiveness  than  procuring  more  modules. 

Procurement  of  WS*  =  [7  15  1]  yields  a  relatively 
high  probability  of  penetration  when  compared  with  the  I  model 
case.  This  is  due  to  introducing  the  combat  parameters 
aB  and  0.  Table  (5.1)  shows  the  probability  of  penetration 
for  decreasing  values  of  a„,  and  increasing  values  of  0. 

n> 
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TABLE  5.1 


BEHAVIOR  OF  PROBABILITY  OF  PENETRATION  PROVIDED 
BY  1MCL  AS  6  INCREASES,  AND  an  -  0 

l 

I 


e 

aB 

Probability  of 
Penetration 

6 

.5 

.47 

6 

.2 

.41 

6 

.1 

.38 

6 

.05 

.36 

6 

.005 

.35 

65 

.005 

.32 

8 

.005 

.24 

85 

.005 

.20 

95 

.00005 

.15 

95 

0 

.15 

99 

0 

.13 

0 

.03 

We  find  the  probability  of  penetration  decreases  as 
decreases  and  9  increases. 

It  is  evident  from  Table  (5.1)  that  the  MOE  improves 
as  0  increases  and/or  decreases.  In  particular  the  MOE 
tends  to  approach  the  value  provided  by  the  1MCL  using  the  I 
model  (i.e. ,  .01) . 

a.  Comparison  with  Simulation  Results 

From  equation  (4.8),  we  obtain  the  following 
readiness  distribution  for  a  squadron  of  7  aircraft  that  has 
15  modules,  and  4  repair  crews  where  the  single-module 
logistics  are  assumed: 


j  01234567 

P(D (0)  =  j}  =  0.0002  0.0014  0.0056  0.0149  0.0298  0.0478  0.0637  0.8366 
Since  E^  is  deployed  the  combat  duration 
is  1  hour.  Therefore  the  MOE  has  to  be  evaluated  at  t  =  1. 
Simulating  the  Markovian  combat  process  {B (t) ,C ( t ) , D (t ) ; 
t  >  0}  for  10,000  replications;  where  a„  =  0.5  and  9  =  0.6  and 

—  h> 

collecting  statistics  at  t  =  1,  we  obtain  the  following 
values  for  P{B(1)  <  3 | B  <  0 )  =  12,D(0)  =  j},  j  =  0,1,... ,7: 

j  =01234567 

P  B(l)  <  3 | B (0 )  =  12, 

D(0)  =  j}  =  0.0  0.0  0.0  0.01  0.09  0.32  0.59  0.80 

The  simulation-of-combat  calculation  gives 

7 

J  P{B(t)  <  3 ] B (0)  =  12,D(0)  =  j}P{D(0)  =  j}  =  .72 

j=0 

i.e.,  probability  of  penetration  =  .28. 

Recall  that  1MCL  gave  a  probability  of  penetra¬ 
tion  value  of  0.47  which  yields  a  relative  error  of  about 
67%.  This  indicates  (as  anticipated  in  Chapter  IV)  that 
the  diffusion  is  very  conservative,  but  is  of  the  correct 
order  of  magnitude.  However,  the  relative  error  drops  as 
B  ( 0 )  +  D(0)  -*•  °°.  Nevertheless,  the  use  of  diffusion  provides 
insights,  and  simple  interpretation  analysis  of  the  problem 
without  an  excessive  computational  burden.  Such  insights  may 
then  be  used  for  more  detailed  investigations  if  required. 
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Analysis  such  as  Table  (5.1)  suggests  that  sensi¬ 
tivity  analysis  can  be  carried  out  easily  on  the  combat- 
logistics  model,  by  changing  logistics  and/or  combat  parameters, 
and  re-solving  the  resulting  model.  The  computational  bur¬ 
dens  of  re-solving  are  not  at  all  excessive,  in  part  because 
the  calculation  of  leakage  probability  is  facilitated  by 
the  diffusion  approximations. 

Note  that  the  leakage  obtained  under  optimal 

3 

logistics  assignment  appear  excessive,  unless  the  C  capa¬ 
bility,  measured  by  0,  can  be  improved,  or  perhaps  the  early 
warning,  and  hence  combat  time,  be  extended.  As  an  example 
of  the  type  of  analysis  that  can  be  carried  out  by  the  use 
of  the  CL  model,  a  training  program  is  analyzed  below, 
b.  Training 

Suppose  the  decision  maker  would  like  to  inves¬ 
tigate  the  effect  of  adopting  a  certain  training  program 
for  the  pilots.  Suppose  that  implementation  of  the  new 
training  program  results  in  improvement  of  pilots'  combat 
and  firing  skills.  Such  improvement  could  be  represented 
through  an  increase  in  the  combat  parameter  aD.  Suppose  that 
if  the  new  training  program  is  adopted,  then  the  defender 
killing  rate  increases  from  =  3 . 0  to  =  4 . 0  bombers  per 

hour . 

Assume  that  aircraft  are  required  to  be  operated 
at  a  higher  rate  (i.e.,  no  simulators)  if  the  program  is 
adopted.  The  effect  of  the  training  program  on  the  logistics 


system  can  be  represented  through  the  failure  rate  X.  Sup¬ 
pose  that  the  training  program  causes  the  failure  rate  to 
increase  from  X  =  0.5  to  X'  =  1.0. 

The  effect  of  the  new  training  program  on  the 
overall  squadron  performance  can  be  evaluated  by  the  use  of 
CL.  The  new  parameters  were  considered  by  the  1MCL  model, 
which  gave  the  following  values:  WS*  =  (7  15  1J  with  an 
objective  value  of  0.398,  i.e.,  a  probability  of  leakage 
of  0.602. 

Comparing  the  results  before  and  after  the 
implementation  of  the  training  program,  we  find  that  even 
though  the  training  program  results  in  an  improvement  in 
the  skills  of  the  pilots  (represented  by  the  higher  killing 
rate) ,  it  has  a  considerable  effect  on  the  logistics  system 
which  in  turn  increased  the  probability  of  leakage  (.4712 
before  implementation  versus  .602  after  implementation). 

5.  2MCL  Using  I  Model 

The  following  parameters  are  used  as  an  illustration 
for  the  2MCL  model  using  the  I  model, 
a.  Cost 

The  squadron  has  been  allocated  a  budget  of  K  =  $75 
million  for  purchasing  WS . 

Each  aircraft  costs  c^  =  $10  million. 

Each  module  of  Type  1  costs  c^  =  $2  million. 

Each  module  of  Type  2  costs  c ^  =  $1  million. 

E^  costs  =  $10  million,  while  E2  costs  = 
million. 


$5 


A  repairman  for  Type  1  has  an  annual  salary  of 

r^  =  $20  thousand,  and  a  repairman  for  Type  2  is  paid 

and  annual  salary  of  r2  =  $10  thousand. 

The  squadron  has  an  annual  budget  for  salaries  of 
Ki  =  $80  thousand  for  repairmen. 

b.  Logistics 

Each  aircraft  fails  at  a  rate  of  X  =  0.5  aircraft 
per  day. 

Condition  probability  of  an  aircraft  failing  due  to 
Type  1  module  is  pi  =  0.4. 

Conditional  probability  of  an  aircraft  failing  due  to 
Type  2  module  is  P2  =  0.5. 

Conditional  probability  of  an  aircraft  failing  due 
to  both  types  of  modules  is  P12  =  0.1. 

An  individual  failed  module  of  Type  1,  or  Type  2, 
has,  respectively,  a  repair  rate  pi  =  0.5,  or  U2  =  1*0/ 
modules  per  day,  where  only  one  repairman  (or  crew) 
can  work  on  a  failed  module  at  any  time. 

pj,  =  2  and  P2  =  2. 

c.  Combat  Data 

Each  defender  kills  at  a  rate  of  «D  =  3.0  bombers  per 
hour. 

If  Ei  is  deployed  then  the  combat  period  is  -  1.0 
hours,  while  if  E2  is  deployed  then  the  combat  period 
is  t2  =  0.8  hours. 

The  2MCL,  in  this  case,  becomes: 
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max  i  }p{ d ( o )  =  ji 

WS  j  =  0 


s .  t . 


10a  +  2M1  +  M2  +  10E1  +  5E2  £  75 


2Ri  +  R2 


<  8 


E1  +  E2 


a  <_  £  2  a 


a  1  m2  —  2a 


1  1  R1  i  M! 


1  <  r2  <  m2 


a  >  2 


ElfE2  binary 


a,  M^,  M2 ,  and  R2  are  positive  integers 


2MCL ( 1 )  is  solved  iteratively  over  all  possible 

WS  that  satisfy  the  constraints.  For  every  j,  u(12,j,t) 

2 

and  o  (12,j,t)  are  determined  using  Result  (4.3)  of  Chapter 
IV  where  t  =  t-^E^  +  fc2E2 ‘  Eor  every  ws >  P 1 D ( 0 )  =  j  }  is 
computed  by  solving  the  forward  Chapman-Kolmogorov  equation, 
using  proposition  (2.1).  Table  (5.2)  shows  the  different 
WS ' s  when  is  deployed  and  the  corresponding  objective 
value.  We  find  that  if  is  deployed,  then  the  optimal  WS  is: 


[4, 8, 8, 3, 2,1] 


TABLE  5.2 


ILLUSTRATION  OF  2MCL(1)  FOR  I 
SCENARIO  WITH  El  DEPLOYED 


A 

Ml 

MS 

M2 

91 

OBJECT  I VE 

92  El  VALUE 

2 

2 

4 

1 

4  1 

0.0439 

2 

2 

4 

2 

4  1 

0.0487 

2 

2 

4 

3 

2  1 

0.0485 

2 

3 

4 

1 

4  1 

0.0625 

2 

3 

4 

2 

4  1 

0.0830 

2 

3 

4 

3 

2  1 

0.0836 

2 

4 

4 

1 

4  1 

0.0723 

2 

4 

4 

2 

4  1 

0.0964 

2 

4 

4 

3 

2  1 

0.0994 

3 

3 

6 

1 

6  1 

0.1 399 

3 

3 

6 

2 

4  1 

0.1931 

3 

3 

6 

3 

2  1 

0. 1955 

3 

4 

6 

1 

6  1 

0. 1 939 

3 

4 

6 

2 

4  1 

0.3160 

3 

4 

6 

3 

2  1 

0.3323 

3 

5 

6 

1 

6  1 

0.2078 

3 

5 

6 

2 

4  1 

0.3791 

3 

5 

6 

3 

2  1 

0.4147 

3 

6 

6 

1 

6  t 

0.2213 

3 

6 

6 

2 

4  1 

0.4162 

3 

6 

6 

3 

2  1 

0.4504 

4 

4 

8 

1 

6  1 

0.2036 

4 

4 

8 

2 

*  ! 

0.3722 

4 

4 

8 

3 

2  1 

C  .  3961 

4 

5 

8 

1 

6  1 

0.2332 

4 

5 

a 

2 

4  1 

0.5027 

4 

5 

e 

3 

2  1 

0.5695 

4 

6 

a 

1 

6  1 

0.2520 

4 

6 

a 

2 

4  1 

0.5777 

4 

6 

9 

3 

2  1 

0.6791 

4 

7 

a 

1 

6  1 

0.2596 

4 

7 

a 

2 

4  1 

0.6265 

4 

7 

3 

3 

2  l 

0.7371 

4 

P 

a 

1 

6  1 

0.2619 

4 

9 

9 

2 

4  I 

0.6609 

4 

a 

a 

3 

2  1 

0 . 7706 

5 

5 

9 

1 

5  I 

0.2239 

5 

5 

5 

2 

4  1 

0.4649 

5 

5 

5 

3 

2  1 

0.6100 

I.e.,  buy  4  aircraft,  8  modules  of  Type  1,  8  modules  of 
Type  2,  assign  3  repairmen  to  Shop  1,  and  2  repairmen  to 
Shop  2,  while  the  last  component  being  1  indicates  the 
deployment  of  .  Choosing  WS-^,  and  assuming  the  2  module 
logistics  system  together  with  the  I  scenario,  results  in  an 
objective  value  of  0.7706. 

Table  (5.3)  shows  the  different  WS ' s  when  E 2 
is  deployed,  and  the  corresponding  objective  value.  We  find 
that  if  E2  is  deployed,  then  the  optimal  WS  is: 

WS,,  =  [4  8  8  3  2  0] 

•L. 

i.e.,  buy  4  aircraft,  8  modules  of  Type  1,  8  modules  of 
Type  2,  assign  3  repairmen  to  Shop  1,  and  2  repairmen  to 
Shop  2,  where  the  last  component  being  0  indicates  the 
deployment  of  E2.  This  yields  an  objective  value  of  0.4925. 

Since  WS^  results  in  a  higher  objective  value 
than  WS 2 i  the  optimal  solution  for  2MCL  is: 

WS*  =  [4  8  8  3  2  1]? 

with  leaking  probability  of  0.2192.  I.e., 


2 


Solving  the  forward  Chapman-Kolmogorov  equations 
for  the  logistics  model,  we  obtain  the  following  readiness 
distribution : 


P { D ( 0 )  =  j}  =  0.0023  0.0143  0.0435  0.0879  0.8519 


Calculate  P{B(1)  <  3 | B  ( 0 )  =  12,D(0)  =  j}  for 
j  =  0,1,. ..,4,  using  the  Markovian  combat  model,  i.e.,  by 
solving  the  resulting  forward  Chapman-Kolmogorov  equations 
(4.59)  numerically.  This  gives  . 


P  { B  ( 1 )  >  3|B(0; 
D  ( 0 )  =  j} 


=  12, 


0.15  0.54  0.79 


Therefore , 


l  P { B ( 1 )  >  3 | B  ( 0 )  =  12 , D  ( 0 )  =  j } P { D ( 0 )  =  j} 

j  =  0 


=  0.73 


i.e.,  a  leakage  probability  of  0.27. 

Hence,  the  2MCL  solution  is  a  reasonably  good 
approximation  for  the  Markovian  formulation  with 


relative  error 


0.27  -  0.22 
0.27 


.19 


6 .  Other  Cases;  Sensitivity  Analysis 
Substituting  WS*  in  2MCL ,  we  obtain: 

10a*  +  2M*  +  M£  +  10E*  +  5E*  <  75 

2R*  +  R*  =8 

M*  =  2a* 

M*  =  2a* 

Comparing  the  above  equations  for  the  optimal 
point  with  the  set  of  constraints  for  2MCL,  we  find  that: 

1.  and  M*  are  at  their  upper  bounds. 

2.  The  annual  budget  constraint  is  binding. 

3.  The  fixed  budget  constraint  is  not  binding  since 

75-10a*  +  2Mf  +  +  10EJ  +  5E$  =  1,  i.e.,  when 

a  =  4,  increasing  and  M2  for  given  R^  and  R2 
results  in  improvement  of  the  objective  value, 

but  and  M2  have  reached  their  upper  bound  before 
the  fixed  budget  constraint  becomes  binding. 

a.  Case  1 

Suppose  we  increase  the  upper  bound  for  M2 , 
reflected  by  increasing  p2  to  2.5  (i.e.,  change  in  the 
right-hand-side) .  The  solution  for  the  new  2MCL  is  shown 
in  Table  (5.4).  The  new  optimal  point  becomes: 

WS*  =[489321] 
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TABLE  5.4 


ILLUSTRATION  FOR  THE  EFFECT  OF  CHANGING  THE 
RIGHT-HAND-SIDE  OF  2MCL(1)  FOR  I  SCENARIO 


6 


wS 

OBJECTIVE 

A 

Ml 

M2 

91 

92  E  l 

value 

2 

2 

5 

1 

5  1 

0.0442 

2 

2 

5 

2 

4  1 

0.0491 

2 

2 

o 

3 

2  1 

0.0490 

2 

5 

1 

5  1 

0.0630 

2 

3 

5 

2 

4  1 

0.0839 

2 

3 

5 

3 

2  1 

0.0550 

2 

4 

5 

1 

5  l 

0.0735 

2 

4 

5 

2 

4  1 

0.0973 

2 

4 

5 

3 

2  1 

0.1015 

3 

3 

7 

1 

6  1 

0.1401 

3 

3 

7 

2 

4  1 

0 . 1 936 

3 

3 

7 

3 

2  1 

0. 1967 

3 

4 

7 

1 

6  1 

0. 1  644 

3 

4 

7 

2 

4  1 

0.3172 

3 

4 

7 

3 

2  1 

0.3360 

3 

5 

7 

t 

6  1 

0.2C33 

3 

•D 

7 

2 

4  1 

0.3810 

3 

5 

7 

3 

2  1 

0.4210 

3 

6 

7 

1 

6  1 

0.2223 

3 

6 

7 

2 

^  i 

0.4106 

3 

6 

7 

3 

2  1 

0.4532 

4 

4 

1  0 

1 

6  1 

0.2057 

4 

4 

10 

2 

4  1 

0.3724 

4 

4 

10 

3 

2  1 

0 . 3979 

4 

5 

1  0 

1 

6  1 

0.2332 

4 

5 

1  0 

2 

4  1 

0.5033 

4 

5 

1  0 

3 

2  1 

0.5754 

4 

6 

1  0 

1 

6  1 

0.2520 

4 

6 

l  0 

2 

4  1 

0.5737 

4 

6 

1C 

3 

2  1 

G .6396 

4 

7 

1  0 

1 

6  1 

0.2537 

4 

7 

1  0 

2 

4  .  1 

0.6277 

4 

7 

1  0 

3 

2  1 

0 . 7509 

4 

3 

9 

1 

6  1 

0 . 2620 

4 

3 

9 

2 

4  i 

0.6619 

4 

Q 

9 

3 

2  1 

0.7303 

5 

£ 

0 

1 

5  1 

C  .2269 

5 

5 

5 

2 

4  1 

0.4649 

5 

5 

5 

3 

2  1 

0.9100 
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with  an  objective  value  of  0.7808.  The  budget  constraint 
is  now  binding,  and  is  at  its  upper  bound  while  M2  is 
not. 

b.  Case  2 

Suppose  we  are  interested  in  seeing  the  effect 
of  changing  the  repair  rate,  i.e.,  change  to  2.0  while 
P2  is  still  2.5.  The  solution  for  the  resulting  2MCL  is 
shown  in  Table  (5.5).  The  new  optimal  point  is: 

WS*  =[489241] 

with  an  objective  value  of  0.8574.  Note  that  increasing  the 
repair  rate  in  Shop  1  has  resulted  in  a  corresponding 
increase  in  the  objective  value,  and  caused  the  optimal 
number  of  repairmen  to  be  assigned  to  Shop  1  drops  from  3 
to  2 ,  and  to  Shop  2  to  increase  from  2  to  4 . 
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TABLE  5.5 


ILLUSTRATION  FOR  THE  EFFECT  OF  CHANGING 
THE  REPAIR  RATE  AT  SHOP  1  OF  2MCL(1) 
FOR  I  SCENARIO  WITH  El  DEPLOYED 


A 

MS 

M2  91 

R2 

El 

OBJECTIVE 

VALUE 

2 

2 

5 

1 

5  1 

0.0360 

2 

2 

5 

2 

4  1 

0.0371 

2 

2 

5 

3 

2  1 

0.0e67 

2 

3 

5 

1 

S  l 

0.1 042 

2 

3 

5 

2 

4  1 

0.1071 

2 

3 

5 

3 

2  1 

0. 1065 

2 

4 

s 

1 

5  1 

0.  1085 

2 

4 

5 

2 

4  1 

0. 1096 

2 

4 

5 

3 

2  1 

0.  1  090 

3 

3 

7 

1 

6  1 

0.3654 

3 

3 

7 

2 

4  1 

0.3795 

3 

3 

7 

3 

2  1 

0.3770 

3 

4 

7 

1 

6  1 

0.4515 

3 

4 

7 

2 

4  1 

C .4770 

3 

4 

7 

3 

2  1 

0.4723 

3 

5 

7 

l 

6  1 

0.4916 

3 

5 

7 

2 

4  1 

0 . 4948 

3 

5 

7 

3 

2  1 

0.4897 

3 

6 

7 

1 

6  1 

0.4926 

3 

6 

7 

2 

4  1 

0.4981 

3 

6 

7 

3 

2  1 

0.4913 

A 

4 

10 

1 

6  1 

0.6493 

4 

4 

1  0 

2 

4  1 

0.6970 

4 

4 

10 

3 

2  1 

0.6949 

4 

5 

10 

1 

6  1 

0.7615 

4 

5 

1  0 

2 

4  1 

0.8196 

4 

5 

10 

3 

2  l 

0.6143 

4 

6 

l  0 

1 

6  1 

0.6120 

4 

6 

10 

2 

4  t 

0.3491 

4 

6 

1  0 

3 

2  1 

0 . 8422 

4 

7 

1  0 

1 

6  1 

0.e360 

4 

7 

1  0 

•> 

4  I 

0.3565 

4 

7 

1  c 

3 

2  1 

0.6467 

4 

4 

9 

1 

6  1 

0 .6472 

4 

3 

9 

2 

4  1 

0 .6574 

4 

3 

9 

3 

2  l 

6.6.194 

5 

5 

5 

1 

5  1 

0.6691 

5 

5 

5 

2 

4  1 

0.7083 

5 

5 

C 

3 

2  1 

0.6751 
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A.  GENERAL  REVIEW 


The  objective  of  this  research  has  been  to  construct  and 
utilize  analytical  models  for  certain  combat-logistics 
situations.  Since  combat  outcome  is  often  crucially 
influenced  by  a  combatant's  readiness,  and  readiness  depends 
strongly  upon  the  adequacy  of  logistics  support,  it  is 
necessary  to  link  an  appropriate  logistics  model  with  one 
for  combat  to  create  a  combat-logistics  (CL)  model.  Use  of 
such  a  combined  model  allows  the  effect  of  the  organization 
and  budgetary  constraints  of  the  logistics  system  upon 
combat  outcome  to  be  directly  assessed  and  optimized. 

The  particular  situation  considered  in  this  dissertation 
has  been  that  of  a  squadron  of  aircraft  designated  to  defend 
a  small  areas  against  surprise  attack  by  wave  of  bombers. 
Upon  detection  of  the  bombers,  ready  defenders  are  vectored 
towards  them  and  engage  them  in  combat.  Combat  outcome  is 
summarized  by  a  measure  of  bomber  leakage  through  the  combat 
zone. 

Both  logistics  and  combat  are  conducted  in  environments 
of  substantial  random  variability  and  the  numbers  on  both 
sides  are  small.  Consequently  stochastic  models  have  been 
developed  for  the  logistics  and  combat  phases  of  the 
scenario  described,  and  these  models  have  then  been  linked. 

304 


The  linked  CL  model  allows  a  decision  maker  to  identify 
fixed  resource  (budget-constrained)  allocations  that 
effectively  minimize  a  chosen  measure  of  bomber  leakage. 

In  order  to  provide  a  usable  analytical  tool,  i.e.,  a  CL 
model  that  can  provide  practical,  reasonable  and  useful 
numerical  outputs  with  feasible  computational  resources, 
mathematical  approximations  have  been  invoked.  Particularly 
is  this  so  in  the  combat  modelling  area,  where  an  essen¬ 
tially  transient  and  multi-state  situation  must  be  modelled. 
Various  approaches  have  been  taken,  but  most  emphasis  has 
been  given  to  a  form  of  diffusion  approximation.  The 
quality  of  this  approximation  improves  when  opposing  forces 
become  large,  but  the  approximation  provides  useful  accurate 
inputs  to  a  logistics  system  optimization  stage  that  would 
otherwise  be  computationally  prohibitive. 

This  chapter  reviews  the  models  constructed  for  analyz¬ 
ing  peacetime  and  wartime  activities.  It  highlights  the 
main  results  obtained,  and  it  points  out  areas  that  require 
further  research. 

B.  PEACETIME  (NON-COMBAT)  ACTIVITIES 

1 .  Single-Module  Logistics  Model 

The  peacetime  (prior-to-combat)  part  of  the  combat- 
logistics  process  was  analyzed  with  logistics  models  in 
Chapters  II  and  III.  This  was  accomplished  initially  by 
representing  a  weapon  system,  i.e.,  a  defending  aircraft, 


subject  to  failures  as  a  single  module.  For  this  single 


module  situation,  a  logistics  model  was  developed  to 
describe  aircraft  readiness  as  a  function  of  the  number  of 
spare  parts,  number  of  aircraft,  number  of  repair  facilities 
and  failure  and  repair  rates.  The  limitation  of  the  model 
is  the  representation  of  an  entire  aircraft  as  a  single 
module. 

2 .  Two-Module  Logistics  Model 

To  overcome  the  limitation  of  the  single-module 
formulation  a  model  was  developed  for  the  case  in  which  the 
aircraft  consists  of  two  modules  both  of  which  are  required 
for  the  aircraft  to  be  considered  mission  capable.  The 
model  allows  for  simultaneous  failures  of  the  two  modules, 
permitting  much  greater  operational  realism  in  representing 
the  logistics  activities  of  an  aircraft  squadron. 

The  model  is  a  bivariate-continuous-time  Markov 
process.  The  size  of  the  corresponding  infinitesimal 
generator  is  (M^+l) (M2+l) ,  which  becomes  very  large  for  even 
moderate  values  of  M^  and  M2.  In  order  to  solve  this 
problem,  the  matrix  geometric  approach  was  implemented. 

With  this  approach  the  infinitesimal  generator  of  the 
process  was  constructed  and  the  limiting  distribution  and 
the  Laplace  transforms  for  general  initial  conditions  were 
determined. 

3 .  Readiness 

In  order  to  compute  the  probability  distribution  for 


the  number  of  aircraft  ready  to  engage  in  combat,  the 


M 


surprise  phenomenon  of  war  was  considered.  In  this  study 
the  element  of  surprise  was  classified  as  total  or  partial 
surprise.  Under  the  total  surprise  scenario,  the  defender 
has  no  time  to  prepare  for  combat,  and  hence  there  is  no 
opportunity  to  cause  changes  to  the  logistics  process. 

Under  the  scenario  of  partial  surprise,  the  defender  is 
assumed  to  have  an  exponential  amount  of  time  to  prepare  for 
combat.  The  combat  preparation  phase  was  modelled  by 
decreasing  the  failure  rate  of  an  individual  aircraft,  and 
increasing  the  repair  rate  of  an  individual  repairman. 

Hence,  a  new  logistics  process  is  introduced.  This  new 
process  uses  the  limiting  distribution  of  the  old  logistics 
process  as  an  initial  condition.  The  probability 
distribution  of  the  number  of  aircraft  ready  to  engage  in 
combat  at  time  of  attack  is  then  computed  by  solving  a 
linear  system  of  equations  for  the  Laplace  transforms.  The 
cases  studied  indicate  the  degree  with  which  readiness  is 
improved  when  there  is  a  warning  time  (i.e.,  partial 
surprise) .  This  evaluation  can  be  used  to  estimate  the 
effect  of  an  improved  intelligence  system  on  aircraft 
squadron  performance. 

4 .  Repairman  Allocation  Model 

The  problem  of  assigning  repairmen  (or  crews)  as  a 
function  of  the  state  of  the  system  was  analyzed  in  Chapter 
III.  Optimal  assignment  was  determined  by  formulating  the 
operational  logistics  system  as  a  multivariate 


discrete-state  continuous-time  Markov  decision  process.  The 
optimal  policy  was  then  computed  by  applying  dynamic 
programming  and  linear  programming  methods  to  the  Markov 
decision  process.  In  order  to  use  Howard's  (1976)  solution 
algorithms  for  solving  a  univariate  Markov  decision  process, 
a  general  one-to-one  transformation  function  for  mapping  a 
multivariate  state  space  on  to  a  univariate  state  space  was 
derived.  This  transformation  facilitated  solving  the 
multivariate  process  as  a  univariate  process  using  existing 
algorithms  and  theory.  The  results  were  then  retransformed 
to  the  multivariate  case  for  the  final  solution. 

5.  Further  Research 

The  logistics  models  presented  in  this  thesis  assume 
modules  that  are  operational  and  not  installed  on  an  air¬ 
craft  to  be  stored  at  a  supply  depot  in  a  ready-to-install 
status.  When  an  aircraft  lands  with  a  failed  module, 
replacement  is  carried  out  instantaneously  if  there  is  a 
module  of  the  same  type  in  the  supply  depot.  This  assump¬ 
tion  may  be  relaxed  by  introducing  a  random  module  replace¬ 
ment  time. 

The  models  studied  in  this  research  assume  that  the 
repair  shop  is  capable  of  conducting  all  types  of  repair.  A 
multi-echelon  repair  system  with  base  and  depot  repair  may 
be  considered  explicitly  by  introducing  a  random  delay 
during  which  time  a  module  is  diagnosed  as  repairable  at  the 
base  with  probability  P ,  or  requires  depot  repair  with 


probability  1-3.  See  Sherbrooke  (1968),  Muckstadt  (1973), 
Hillestad  (1982),  and  Homesby  (1985). 

Other  distributions  can  be  assumed  for  the  warning 
time.  Gaver  (1966)  examined  a  class  of  densities  that  is 
convenient  for  representing  warning  times  and  presented  a 
method  for  obtaining  an  approximate  inverse  of  the  Laplace 
transform.  This  provides  some  generalization  in  modelling 
surprise  and  the  effect  of  an  improved  intelligence  system. 
This  is  an  area  that  merits  further  research.  The  results 
presented  in  Chapter  II  show  that  the  element  of  surprise 
plays  a  major  role  in  providing  a  link  between  the  logistics 
and  combat  processes  through  its  impact  on  the  initial 
conditions  of  the  combat  process. 

The  repairmen  allocation  model  assumes  neither  cost 
nor  time  involved  in  assigning/reassigning  repairmen  to 
shops.  The  assumption  of  no  elapsed  time  required  to 
reassign  repairmen  to  shops  may  be  relaxed  by  introducing  a 
"state  of  transition"  for  repairmen.  If  a  repairman  in  one 
shop  is  reassigned  to  another,  then  the  repairman  experi¬ 
ences  a  delay  (is  said  to  be  in  limbo)  for  an  exponential 
amount  of  time.  One  can  also  include  costs  in  the  repairman 
assignment  problem.  Two  straightforward  ways  to  do  this 
are : 

(i)  Introduce  another  objective  function.  The  model 

then  has  two  objective  functions.  One  is  to  maxi¬ 
mize  the  long  run  expected  number  of  aircraft  ready 
to  engage.  The  second  is  to  minimize  the  long  run 
expected  cost.  The  model  can  then  be  solved  as  a 


multiple-objective  Markov  decision  process;  see 
Viswanathan,  Aggarwal  and  Nair  (1977) . 


(ii)  Add  a  new  constraint  which  indicates  that  the  long 
run  cost  must  not  exceed  a  certain  bound.  The 
resulting  model  can  then  be  solved  for  different 
values  of  the  bound.  A  plot  of  the  objective  value 
(i.e.,  the  expected  number  of  aircraft  operational) 
versus  the  long  run  expected  cost  can  then  be 
constructed. 


C.  WARTIME  (COMBAT)  ACTIVITIES 

Analytical  models  for  representing  air-to-air  combat 
were  studied  in  Chapter  IV.  The  major  areas  are  summarized 
below. 

1.  The  Finite-Re-Engaaement  Rate  Combat  Model  (the  BCD 

Models 

The  BCD  model  assumes  that  defenders  are  vulnerable 
and  spend  some  time  searching  for  a  free  enemy  bomber.  Once 
a  free  bomber  is  detected,  it  is  then  engaged  by  a  free 
defender  until  either  one  of  them  is  killed.  If  the  bomber 
is  killed,  the  defender  once  again  searches  for  a  free 
bomber;  if  a  bomber  wins,  or  is  never  engaged  in  combat,  it 
may  leak  through  the  combat  zone  and  attack  the  area 
defended. 

The  combat  process  under  the  BCD  scenario  was 
initially  modelled  deterministically  by  a  system  of  differ¬ 
ential  equations.  The  deterministic  model  provides  repre¬ 
sentation  of  the  number  of  free  bombers,  bombers  (hence 
defenders)  in  combat,  and  free  defenders  as  a  function  of 
time.  A  simple  criteria  for  defenders/borabers  to  win  was 


obtained  in  case  combat  time  available  is  unlimited.  An 


equation  that  predicts  (approximately)  the  expected  number 
of  defenders/bombers  surviving  was  presented. 

The  deterministic  model  was  then  generalized  by  a 
diffusion  model.  The  use  of  diffusion  theory  allowed  us  to 
represent  some  combat  measures  of  effectiveness  in  near 
closed  form  mathematical  equations.  This,  in  turn,  simpli¬ 
fied  the  linking  of  the  combat  models  to  the  logistics 
models . 

A  trivariate-continuous-time  discrete-state  Markov 
model  (in  particular  a  trivariate  pure  death  process)  was 
developed  to  represent  the  BCD  combat  process.  A  method  for 
computing  the  Laplace  transforms  of  the  time-state  proba¬ 
bilities  was  presented.  The  Markov  process  was  simulated  to 
check  the  results  of  the  diffusion  model.  It  was  found  that 
the  diffusion  results  provided  good  approximations  to  the 
Markov  process. 

The  diffusion  results  were  found  to  produce  an 
approximation  to  the  expected  number  of  aircraft  alive  at 


time  t  that  was  identical  to  that  provided  by  the  deter¬ 
ministic  models.  In  addition,  the  diffusion  results  provide 
an  approximation  for  the  variance-covariance  matrix.  Thus, 
probability  statements  can  be  e  'aluated  by  using  the  normal 
approximation . 

The  dimension  of  the  system  of  differential  equa¬ 
tions  resulting  from  the  diffusion  approximations  is  not  a 
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function  of  the  initial  size  of  the  forces.  This  allows 
military  analysts  to  model  economically  combat  processes  for 
larger  size  problems.  It  also  allows  military  analysts  to 
derive  expressions  for  approximating  probability  statements 
that  represent  measure  of  effectiveness  and  to  compute  their 
values  without  expenditure  of  excessive  computer  time. 

2 .  The  Infinite  Re-Enaaaement  Rate.  I  Model 

The  I  model  assumes  that  defenders  are  invulnerable, 
and  once  a  bomber  is  killed  a  free  defender  engages  a  free 
bomber,  if  any,  instantaneously.  The  combat  process  was 
modelled  deterministically  by  a  differential  equation.  The 
equation  was  solved  to  provide  an  expression  that  approxi¬ 
mates  the  expected  number  of  bombers  alive  as  a  function  of 
time. 

The  deterministic  model  was  then  generalized  by 
developing  a  diffusion  model.  Expressions  that  represent 
the  mean  and  variance  of  the  number  of  bombers  alive  at  time 
t  was  derived.  It  was  found  that  the  deterministic  and  the 
diffusion  models  gave  the  same  representation  of  the  mean. 

A  simple  univariate  pure  death  model  was  developed 
to  represent  the  I  combat  process.  It  was  found  that  the 
diffusion  results  provided  good  approximation  to  the  pure 
death  model.  An  expression  for  the  expected  number  of 
bombers  alive  as  a  function  of  time  was  derived. 

To  allow  more  refined  approximate  calculations  to  be 
made  for  the  I  model,  the  large  deviations  method  was 
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applied.  A  large  deviations  equation  was  derived  to 
approximate  the  probability  of  at  least  z  bombers  alive  at 
time  t  for  relatively  large  values  of  t.  It  was  found  that 
the  large  deviations  technique  resulted  in  a  better 
approximation  for  the  measure  of  effectiveness  than  did  the 
diffusion  approximations.  As  yet  there  is  no  known  way  of 
applying  large  deviations  to  the  BCD  model.  Hence  the 
diffusion  approximation  has  been  used  in  the  logistics 
optimization  phase  of  the  problem. 

3 .  Further  Research 

The  application  of  the  large  deviations  method  to 
multivariate  stochastic  combat  models  appears  to  be  a  ripe 
area  for  further  research. 

Diffusion  models  were  used  to  generalize  the  deter¬ 
ministic  models  for  air-to-air  combat.  It  would  be  useful 
to  develop  similar  models  to  generalize  (approximate)  the 
deterministic  (Markovian)  models  for  other  types  of  combat 
(e.g. ,  land,  sea,  ground-to-air,  etc.).  See  Appendix  B  for 
a  generalization  of  Lanchester's  linear  law;  there  it  is 
shown  that  the  diffusion  mathematics  recovers  Lanchester's 
linear  law  and  provides  in  addition  a  representation  for  the 
variance-covariance  matrix  of  the  approximating  multivariate 
Gaussian  process. 

D.  COMBAT-LOGISTICS  MODEL 

Chapter  V  was  devoted  to  linking  the  analytical 
logistics  models  with  the  diffusion  models  of  combat  to 


produce  a  combat-logistics  model.  The  combat-logistics 
model  is  a  non-linear-integer-mathematical  programming 
model .  That  model  determines  the  optimal  number  of 
aircraft,  modules,  and  the  type  of  early  warning  system  to 
be  procured,  given  fixed  budgetary  constraints.  In 
addition,  the  optimal  number  of  repairmen  to  be  recruited 
(employed)  is  determined.  The  solution  minimizes  the  proba¬ 
bility  of  penetration  of  enemy  bombers  subject  to  budget, 
operational,  and  capacity  constraints  on  the  defenders. 

1.  Further  Research 

Further  work  remains  to  be  done.  The  combat- 
logistics  model  described  in  this  thesis  allows  a  decision 
maker  to  evaluate  the  outcome  of  air-to-air  combat,  and 
hence  provides  the  initial  distribution  of  the  number  of 
bombers  to  be  engaged  by  SAM  forces.  An  analytical  model 
for  the  ground-to-air  combat,  that  can  be  grafted  onto  the 
proposed  combat-logistics  model,  is  also  needed.  A 
generalization  to  the  combat-logistics  model  that  allows  for 
repeated  enemy  attacks  over  a  short  period  of  time  is  also 
needed. 

E.  CONCLUSION 

The  research  presented  in  this  thesis  represents  an 
effort  to  develop  analytical  models  which  can  be  used  to 
assist  decision  makers  in  making  some  of  the  complex  logis¬ 
tics  decisions  having  an  impact  on  combat  effectiveness. 


This  work  represents  the  first  known  effort  to  integrate  the 
logistics  and  combat  processes  analytically. 

Combat-logistics  models  of  the  type  illustrated  here 
appear  to  have  much  to  recommend  them.  Making  decisions 
under  a  peacetime  environment  that  can  considerably  affect 
combat  outcomes  is  a  complex  task.  The  use  of  combat- 
logistics  models  similar  to  those  presented  here  can  assist 
the  decision  maker  in  answering  "what  if"  questions 
interactively  without  expenditure  of  excessive  computer 
time.  The  models  can  also  be  used  to  assist  the  planner  in 
determining  the  effects  of  implementing  new  policies,  cuts 
(or  increases)  in  the  annual  maintenance  budget,  reductions 
in  the  number  of  modules,  increases  in  the  number  of 
aircraft,  improvement  of  the  intelligence  system,  modifica¬ 
tion  of  the  early  warning  system,  or  improvement  in  the 
communication,  command  and  control  system. 
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APPENDIX  A 


NUMERICAL  STUDIES  IN  LARGE  DEVIATIONS 

A.  GENERAL 

This  appendix  is  designed  to  analyze  the  large  deviations 
technique  for  evaluating  probabilities  at  large  values.  The 
analysis  includes:  Deriving  the  large  deviations  equation; 
comparing  it  with  actual  values  and  with  central  limit  theorem 
(CLT )  results;  and  performing  error  analysis  for  the  entire 
range  of  the  independent  variable. 

The  idea  of  the  large  deviations  technique  is  to  displace 
the  distribution  of  the  random  variable  toward  the  value  of 
interest,  which  is  situated  in  the  tail  of  the  distribution. 
Applying  the  Normal  approximation  to  the  displaced  distribu¬ 
tion  gives  a  new,  better  approximation  to  the  actual  proba¬ 
bility  (Feller,  1971). 

The  appendix  applies  the  large  deviations  technique  to 
the  compound  Poisson  process  and  renewal  processes. 

An  approach  to  reduce  the  large  deviations  error  is 
introduced  by  shifting  the  value  of  interest  with  a  prescribed 
interval.  This  approach  is  fully  illustrated  for  the  com¬ 
pound  Poisson  process. 

B.  LARGE  DEVIATIONS  CONCEPT 

Suppose  Y1,Y2,...,Yn  are  independent  and  identically 
distributed  random  variables  with  a  common  distribution 
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2  2 

F  ( • )  /  such  that  E[Y.]  =  0  and  E[Y,)  =  o  ,  then  the  normalized 
n 

sum  (  £  Y,  )/(o/n)  has  the  "n"  fold  distribution  F  .  By 
k=l  K 

the  CLT,  Fn  tends  to  the  standard  normal  ($). 

For  large  x,  $(x)  is  close  to  unity,  which  indicates 
that  for  very  large  values  of  x,  the  CLT  becomes  empty.  To 
overcome  this  problem,  the  large  deviations  (LD)  technique 
was  suggested  by  Esscher  (1932).  Also  see  Feller  (1971);  for 
a  recent  application  of  the  technique  see  Mazundar  and  Gaver 
(1984)  . 

We  now  derive  the  LD  equation  for  P{X  >  z},  where  X  is 
either  a  fixed  or  a  randomized  sum  of  i.i.d.  random  variables. 
Let  Fv(x)  be  the  probability  distribution  function  for  X, 

X 

and  F  (s)  is  the  corresponding  moment  generating  function; 

X 

then, 

^  <» 

Fx(s)  =  /  eSU  Fx(du}  s  >  0  (A-l) 

—  00 

Let  V  be  the  probability  distribution  associated  with 

2 

Fx ( ‘ ) ,  with  mean  y  and  variance  o  .  Then: 


i  a 

|  Let  V(£)  be  the  moment  generating  function  of  V.  Then: 


I  V(£)  =  /  e?x  V{dx} 

i  J 

i 


Substituting  (A-2)  and  (A-l) ,  we  obtain: 


~  F  (s+E,) 

V(C)  =  -  (A- 3 ) 

Fx(s) 


If  K(£)  is  the  cumulant  generating  function  for  V,  then, 


A 

K(£)  =  In  V(£) 


It  follows  that, 

> 

i 

I 

j  y(s)  =  K '  ( 0 ) 


and 


o2 (s)  =  K"  (0)  . 


2 

Note  that  y  and  a  are  functions  of  s,  i.e.,  there  is  a 
family  of  associated  distributions  for  ( ■ ) . 

Let  y(s)  =  z  (i.e.,  center  the  associated  distribution  at 
the  point  of  interest),  and  solve  for  s.  Let  s  be  the  value 
of  s  such  that  y(s)  =  z.  Thus,  a  unique  associated  distribu¬ 
tion  V  has  been  determined,  i.e.: 
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with : 


mean  =  u (s)  =  z  , 


and 


2  ~ 

variance  =  o  (s) 


Thus , 


Fx(dx} 


Fx(s)  e"6*  V{ dx } 


1 .  e. 


1  -  Fx(z) 


Fx(s)  /  e  V{dx} 
z 


By  the  normal  approximation: 


1  -  Fx(z) 


Fx(s) 


00  -  _  (x-u  (s) ) 2 

_L_  j  e~sx  e  2°  (s)  dx 
/2tt  z  o  (s) 


By  standard  substitution,  and  after  completing  the  square, 
we  get: 
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1"Fx(z) 


~  ~  s2  2  l'-~2 

-sy(s)+-=-a  (s)  ,  »  -y(u)+SO  (s)  ) 2 

Fx(s)e  2  /  e  2  da) 

/2tt  0 


Considering  the  transformation  x  =  w  +so(s),  we  obtain: 


1_FX{2) 


-  ,  i2  2  ~ 

~  _  -sy(s)+^o  (s)  ,  00 

Fx(s)e  1  —  /_  „ 

/2tF  so  (s ) 


2  /-j 

- x  /2  , 

e  dx 


Hence,  the  LD  equation  is: 


1-Fx(z) 


Fx(s)e 


i2  2  . 

-sy(s)+-jc  (s) 


[1-4 (so (s) ) ] 


(A- 4) 


where : 


FXU) 
y  (s) 
o2  (s) 


moment  generating  function  of  X 
mean  of  V  =  z 
variance  of  v. 


The  above  equation  is  the  LD  equation  with  parameters 
(Fx(s) ,y (s) ,o  ( s )  } .  The  claim  in  this  appendix  is  that  any 
probability  value  computed  for  a  point  that  is  far  in  the 
tail  using  equation  (A-4)  will  result  in  a  better  approxima¬ 
tion  for  the  actual  probability  than  CLT. 

Numerical  studies  were  conducted  to  compare  the  CLT  to 

the  LD  approximations.  This  is  done  according  to: 

The  length  of  the  interval  on  the  real  line  over 
which  better  results  were  achieved. 
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The  variation  in  the  relative  error  over  the  range  of 
the  independent  variable. 


The  behavior  of  each  approximation  at  both  relatively 
small  and  large  values. 

C.  LARGE-DEVIATIONS  APPLICATIONS 

1 .  An  Application  To  Compound  Poisson  Process 

Let  { N  ( t )  ;  t  >_  0}  be  a  Poisson  process  with  mean  At, 
and  {Y^,  i  =  1,2,...}  be  a  family  of  i.i.d.  random  variables 
with  distribution  ( • ) ;  where  N(t)  and  Y^  are  assumed  to 
be  independent.  Define, 

if  N ( t )  =  0 

if  N ( t )  >  0 

It  follows  that  X ( t )  is  a  compound  Poisson  process,  with 
distribution 

Suppose  we  are  interested  in  evaluating  P{X(t)  >  z} 
where  z  lies  on  the  extreme  right  tail  of  the  distribution. 

Let  4>y(s)  be  the  moment  generating  function  of  Y^, 

then : 

OO 

fy(s)  =  /  esy  dFY{y}  s  >  0 

—  <30 

Let  F  ... (s)  be  the  moment  generating  function  of  X(t). 

X  ( t ) 

Then : 


(  0 


N(t) 

S.l  Yi 

FX(t)  (s)  =  E[esX(t)]  =  E  [E [e  1  1  | N (t) ] ] 


=  E[  (<dv(s)  )N(t)  ] 


Hence , 


— X  t  [  1— 'S)J 

FX(t) (s)  =  e  s  >  0 


(A-5) 


To  shift  the  distribution  F(*)  to  the  right,  we 
associate  with  it  the  new  probability  distribution  V(*)» 
such  that 


V{dx}  = 


e  F„ , . . { dx} 


X(t) 


X(t) 
^  (s) 


s  >  0 


(A- 6) 


Let  V(£)  be  the  moment  generating  function  for  V(*) 

/v 

Therefore  V(£)  is  given  by  (A-3);  substituting  (A-5)  we 
obtain : 


~  X t [ <t>  (s+£)-4>y(s)  ] 

V(C)  =  e  x  1  s  >  0 ,  ^  >  0  (A- 7 ) 


The  cumulant  generating  function  becomes: 


K(0  =  A t  ( 4>y  (s+£ )  -  <*>Y  ( s ) ) 


(A- 8) 


Differentiating  (A-8)  with  respect  to  C ,  and  setting 
£  =  0 ,  we  obtain  the  following  expression  for  the  mean  of  v: 


U  (s)  =  X  t  4>^  (s) 

Differentiating  (A-8)  twice  with  respect  to  £ ,  and 
setting  £  =  0 ,  we  obtain  the  following  expression  for  the 
variance  of  V: 


c2(s)  =  Xt  <^(s) 

Let  s  =  s(z):  z  =  Xt  <|>^(s(z)),  i.e.,  let  s  be  the 
value  of  s  that  centers  the  distribution  at  the  point  of 
interest.  It  follows  that: 

p(s)  =  At4>y  (s)  =  z  (A- 9 ) 


and 


o2(s)  =  Xt<J>Y  (s) 


(A-10 ) 


From  (A—  5 ) ,  we  also  obtain: 


FX(t) 


(s) 


-Xt  [1-<J>Y  (s)  ] 
e  1 


(A- 1 1 ) 


Substituting  (A-9)-(A-ll)  into  (A-4),  we  obtain: 


P{X(t)  >  z}  - 


-At  (l-<Py  (s)  +s^  (s)  — j<t>  "  (s)  ] 


x  [1  -  $(s/At^"(s) )] 


(A-12 ; 


2.  Example 


Suppose  {Y^,  i  =  1,2,...}  is  a  family  of  independent 


exponentially  distributed  random  variables  with  mean  u 


Recall  that  N(t)  is  a  Poisson  process  with  mean  At. 


a.  Computing  Actual  Probability 


Let  be  the  density  function  for  X(t) 


Then: 


CO 

fx(t) (x)  =  I  P{N(t)  =  n}  fn 

v  1  n=l 


where : 


f  is  the  Gamma  distribution  with  parameter  (n,p) 


FX(t) <x) 


x  °°  ,  .  , .  ,  .  n  ,  .  n-1 

-  /  l  ^  -^TJT  dx 

0  n=l  n-  1  ' 


N(t)  >  0 


P  {  X  ( t )  =  0  }  =  P  { N  ( t )  =  0 }  =  e‘ 


1 


Hence : 


-At 


x  =  0 


FX(t)(x)  = 


y  -At (Xt)n(1  ny  c-yx(ux) J 
n!  j=0 


)  x  >  0 


n=l 


b.  Computing  Probability  Using  the  Central  Limit 
Theorem 


E  [X  ( t )  ]  =  E  [N  ( t )  ]  •  E  [ Y]  =  — 


Var (X ( t) )  =  E [N (t ) ]  •  E  [ Y  ]  = 


A  t  ( — ■*"  — 2") 

y  y 


2  At 


Hence 


P{X(t)  >  z}  “  1  - 

1/y (/2 A t) 


c.  Computing  Probability  Using  Large  Deviations 

The  moment  generating  function  for  {Y^,  i  =  1,2,...} 


is  given  by: 


i>Y<s> 


From  ( A-9 )  we  get: 


z  =  At - - - j 

(m-s) 
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It  follows  that: 


s  =  u  ±  /(Xtp)/z  , 


But  s  <  p,  therefore  we  obtain: 


s  =  p  -  / (Xtp)/z 


Hence : 


-Atll-$v(s)+s4>'  (s)-^-4>"(s)] 
P(X(t)  >  z }  =  e  Y  Y  Y 


X  {1  -  $  (s/Xt4>y  (s)  )  } 


where : 


s  =  p  -  /  (X  tp  )  /z 


<*>  Y  <s )  = 


p  -s 


<D^(s) 


^>Y(s) 


p 


(p-s) 

2p 

(p-s) 


d.  Data 

The  following  data  are  used  to  compare  CLT  and  LD 
to  the  actual  probabilities  of  the  compound  Poisson  process: 
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{ N  ( t )  ;  t  >_  0;  is  a  Poisson  process  with  mean  Xt,  where 
X  =  1,2,3,  and  4 . 


{Yj_;  i  =  1,2,...}  is  a  family  of  i.i.d.  exponential 
random  variables  with  rate  y  =  1,  0.5,  0.33,  and  0.25. 


The  precision  used  for  calculating  the  actual  proba¬ 
bility  value  is  0.1  xl0~6. 


The  probabilities  were  evaluated  at  "z"  values  ranging 
from  1.0  up  to  zmax,  where  the  actual  probability 
of  being  greater  than  zmax  is  less  than  0.1  xio~°. 


The  error  for  both  CLT  and  LD  is  defined  as: 


Relative  error  = 


Actual  Probability  -  Estimated  Probability 
Actual  Probability 


D.  RESULTS  ANALYSIS 


Figure  (A.  1)  shows  the  intervals  of  z  over  which  the  CLT, 


or  the  LD,  gives  better  approximation.  The  figure  shows  16 


cases  where  z  was  chosen  such  that  it  is  oreater  than  the 


mean  of  the  compound  Poisson  process.  The  figure  shows  that 


the  LD  technique  yields  better  approximation  for  larger 


intervals  than  the  CLT  approximation. 


Figure  (A. 2)  shows  the  variation  of  the  error  with 


respect  to  z  values  for  the  first  four  cases,  i.e.,  X  =  1.0, 


and  y  =  1.0,  0.5,  0.33,  and  0.25.  The  four  cases  show  that 


errors  tend  to  behave  in  a  similar  way.  It  is  evident  from 


the  figure  that  CLT  tends  to  lose  accuracy  very  rapidly  for 


values  of  z  that  are  not  very  far  from  the  mean  value.  On 


the  other  hand,  it  seems  that  the  LD  approximation  is  improv¬ 


ing  in  accuracy  as  the  value  of  z  increases.  The  figure 


CI.T 


Error  Analysis-Compound  P.P.  (Poisson(l)) 


shows  that  the  worst  accuracy  the  LD  gives  is  at  relatively 
small  values  of  z;  the  error  is  relatively  small  when  com¬ 
pared  with  the  maximum  error  the  CLT  generates  at  relatively 
high  values  of  z,  which  in  all  of  the  cases  studied  was  found 
to  converge  to  100%  error. 

Figure  (A. 3)  illustrates  the  actual  probabilities  versus 
CLT  and  LD  approximations  (in  logarithmic  scale)  for  the 
above  four  cases.  The  plots  show  that  generally  the  LD 
results  in  a  good  approximation,  especially  for  large  z  values, 
and  it  always  overestimates  the  actual  probability  (at  least 
for  the  cases  examined  so  far) .  The  deviation  from  the  actual 
probability  tends  to  decrease  as  z  increases.  The  figure 
indicates  that  LD  error  tends  to  decrease  as  y  increases. 

To  get  a  better  understanding  on  the  behavior  of  both 
approximations,  case  (4)  (i.e.,  X  =  1.0,  and  y  =  0.25)  was 

studied.  Figure  (A. 4)  illustrates  the  comparison  between 
the  actual,  CLT,  and  LD  probabilities  at  small  z  values. 

The  figure  indicates  that  CLT  results  in  a  better  approxima¬ 
tion  than  the  LD  technique. 

Figure  (A. 5)  illustrates  the  comparison  between  the 
actual,  CLT,  and  LD  at  relatively  large  values  of  z  for  case 
4.  The  plot  supports  the  previous  conclusion  that  LD  gives  a 
good  approximation  for  the  actual  probability  at  large  values 
of  z . 

1 .  An  Application  to  a  Renewal  Process 


Let  { N  ( t ) ,  t  >  0)  be  a  renewal  process.  Suppose  we 
are  interested  in  evaluating  P(N(t)  <  z}  for  large  values  of 


sson  Process 


Comparison  at  Small  Values  of 


t.  Define  X(n)  to  be  the  waiting  time  for  the  nt*1  renewal. 
The  event  (N(t)  <  2}  is  equivalent  to  the  event  (X(z)  >  t}. 
Hence,  we  are  interested  in  evaluating  P{X(z)  >  t}. 

Let  Yn  be  the  time  between  the  n*-*1  and  (n+l)s<:  event, 
and  {^n,  n  =  1,2,...}  is  a  family  of  i.i.d.  random  variables 
with  distribution  F(*).  Therefore: 

z 

p{x(z)  >  t}  =  p{  l  Y.  >  t} 

i=l  1 

where  t  lies  in  the  extreme  right  tail  of  the  distribution. 
Let 


(p  (s)  =  E[eSY]  =  /  esy  dF{y } 


sy 


Let 


^Xln)'51  *  EUSX(n,l 


It  follows  that, 


FX(n)  (s)  =  (,^Y(S)  }  s  >  0 


( A- 1 3 ) 


Define : 


v{dx) 


eSX  FX(n)ldxl 
*X(n) <sl 
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s  >  0  , 


The  moment  generating  function  is  given  by: 


V(£)  = 


FX(n)(s+«» 


FX(n)(s> 


s  >  0 ,  E  >  0 


Substituting  (A-13) ,  we  obtain: 


V(£)  = 


<P  v(s+£)  z 
(  4>v(s)  } 


The  cumulant  generating  function  becomes: 


K(£)  =  z  {  £n  (  $Y  ( s+E )  )  -  £n  (  4>y  (s)  )  } 


(A-14 ) 


(A- 15 ) 


Dif  ferentiaing  (A-15)  with  respect  to  E>  and  at  E  =  we 
obtain: 


z  <f>^(s) 


Differentiating  (A-15)  twice  with  respect  to  and  at  £  =  0 , 
we  get: 

->  z4>  (s)<t."(s)  -  z(4>’(s))2 

<3  ( s )  =  — i - - - p -  s  >  0 

(  0Y  ( S )  ) 


Let 


Z  (J)  ’  ( s ) 

s  =  s  (t)  :  t  =  — — r— r 


(A-16 ) 


i.e.,  s  is  the  value  of  s  that  centers  the  associated  dis¬ 
tribution  at  the  point  t. 

From  (A-4),  the  LD  equation  for  the  renewal  process 

becomes : 


P{N { t)  <  z} 


(*Y(s))z 


-  l~2  2  - 

-St+is  a  (s) 

e  { 1  -  4>  (so  (s)  )  } 


(A-17) 


where : 


2  ,  ~ . 

a  (s) 


z<f>Y  (s)  4>y  (s)  -  z  (<(>y  ( s) )  ‘ 
~2 - 


(<pv  (s)  ) 


and  s  is  given  by  (A-16) . 

The  application  of  the  CLT  to  the  renewal  process 
is  given  by  the  following  theorem  (Ross,  1983) : 

Theorem: 

2 

Let  y  and  a  ,  assumed  finite,  represent  the  mean  and 
variance  of  an  interarrival  time.  Then, 

(  N  ( t )  -t/y  )  1  -x^/2  j 

p  < -  ■  <  y  >  ■*  -  j  e  dx  as  t 

(o  ^  t/y  3  )  /2?  -» 


where  (N(t),  t  >_  0 }  is  a  renewal  process.  I.e.,  N(t)  is 
asymptotically  normally  distributed  as  t  ■*  ». 
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E.  TOWARDS  A  BETTER  APPROXIMATION  FOR  LARGE  DEVIATIONS 


a 


Although  the  LD  yields  a  better  approximation  to  the 
actual  probability  values,  a  more  detailed  research  work  was 
done  towards  improving  the  approximation.  This  work  is  based 
on  investigating  the  skewness  of  the  associated  distribution 
V.  The  experiments  done  for  the  compound  Poisson  process  indi¬ 
cates  that  the  skewness  value  for  the  associated  distribution 
is  generally  positive,  i.e.,  it  is  skewed  to  the  right.  This 
led  to  carrying  out  some  numerical  studies  to  determine  the 
effect  of  shifting  the  mean  of  the  associated  distribution  an 
amount  A . 

Equation  (A— 9 )  becomes: 


z  +  A  =  At  4>y(s) 


Using  (A-5)  and  (A-6) ,  we  obtain: 


(A-18) 


P{X(t)  >  z}  =  e 


By  the  Normal  approximation: 


-At  [1-<J> '  (s)  ]  °° 


/  e  v{dx} . 


P{X(t)  >  z}  - 


-XU1-*  (s)l 

2  -  j  e  e 

/2tT  z 


(x-Atp^(s) )' 
2At^(s) 


/At$y  (s) 


By  standard  substitution  (considering  (A-18),  we  obtain: 


P{X(t)  >  z}  -  e 


— Xt  [1— 4>  (s)  ]  i  00 

T=/ 

v/2tT  -A 


CO 


-s  (At<j>^  (s)  +o)  At4>£  (i)  — 2 
e  dco 


At4>£(s) 


Completing  the  squares,  we  obtain: 


P{X(t)  >  z}  -  e 


-At  [l-4>y  (s)  +i4>^  (s)  ■ — ^-4>y  (s)  J  1 

v/2t t 


-|  — — ^ 

-4(u)+sAt<j>"  (s) ) 

e  ^  Y  dco 


-A 


/At4>"(s) 


Considering  the  transformation  x  =  co+s/At(J>^  (s )  ,  we  obtain: 


P{X(t)  >  z}  -  e 


-At[l-<}>  (s)+s<}> '  (s)-^-4>"  (s)  ]  .  , _ 

Y  ($(  —  ■  ■  -  §  Au:i(s)) 

/At4>"(s)  Y 


The  following  algorithm  was  used  for  computing  A*,  where 
the  minimum  relative  error  is  achieved: 

1 .  Set  A^  =  0 ,  k  =  1 . 

2.  Set  the  mean  of  the  associated  distribution,  p(s)  =z  +  A^- 

3.  Compute  P{X(t)  >  z},  (actual  and  LD)  for  the  compound 
Poisson  process.  Evaluate  the  relative  error  e^, ,  and  the 
skewness  coefficient  C^,  where: 
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F.  DELTA-TECHNIQUE:  RESULTS  ANALYSIS 

Implementing  the  proposed  technique  leads  to  a  better 
approximation  to  the  actual  probability  values.  For  example, 
it  was  found  that  for  the  case  of  X  =  1,  and  y  =  1 ,  the  maxi¬ 
mum  relative  error  for  z  values  greater  than  the  mean  of  the 
compound  Poisson  process  is  .0006. 

The  numerical  studies  done  indicate  that  the  large  devia¬ 
tion  using  the  delta  approach  gives  better  approximation  over 
the  entire  range  of  z-domain,  even  in  the  intervals  where  the 
CLT  previously  gave  better  approximations,  i.e.,  for  relatively 
small  z  values. 

The  numerical  studies  also  indicate  that  as  A  increases, 
both  the  skewness  coefficient  and  the  relative  error  tend  to 
decrease  for  a  fixed  z  value.  This  continues  until  A*,  where 
the  relative  error  starts  to  increase,  while  the  skewness 
coefficient  continues  to  decrease.  All  cases  studied  indicate 
that  A*  is  reached  before  the  skewness  coefficient  reaches 


the  value  of  zero.  This  observation  leads  to  the  conclusion 
that  the  best  associated  distribution  doesn't  necessarily 
have  to  be  symmetric. 

Figure  (A. 6)  shows  the  values  of  A*  for  a  given  value 
of  z  for  16  cases  (y  =  1,  .5,  .33,  .25;  and  A  =  1,  2,  3,  4). 

The  figure  points  out  an  interesting  feature:  The  value  of 
A*  can  be  chosen  to  be  a  fixed  value  for  each  y.  These  average 
A*  values  are: 

If  y  ^  =  1  the  average  A*  =  2.2 

If  y  =  2  the  average  A*  =  4.4 

If  y  ^  =  3  the  average  A*  =  6.6 

If  y  ^  =  4  the  average  A*  =  8.8 

Note  that  average  A*  =  2.2(y  ,  and  it  is  independent  of 

A.  Applying  this  criterion  for  determining  A  to  all  of  the 
16  cases  resulted  in  a  maximum  relative  error  of  .08  over  the 
entire  range  of  z.  The  proposed  approach  (i.e..  A*  =  2.2 (y  )), 
in  addition  to  providing  better  approximations  than  the  CLT  over 
the  entire  domain,  gives  a  simple  algorithm  to  follow.  On 
the  other  hand,  if  a  better  approximation  is  required,  then 
some  work  has  to  be  invested  in  constructing  a  table  that 
indicates  the  value  of  A  for  every  z  for  various  rate  values. 


APPENDIX  B 


LANCHESTER'S  LINEAR  LAW;  A  GENERALIZATION 

A.  GENERAL 

This  appendix  is  designed  to  generalize  Lanchester's 
linear  law  (LLL) .  Let  B(t)  and  D(t)  be  the  surviving  com¬ 
batants  at  time  t  in  the  attacker  and  defender  forces, 
respectively.  Assume  B(0)  =  B,  and  D(0)  =  D. 

Let  aD  (otg)  be  the  rate  at  which  an  individual  defender 
(attacker)  kills  an  individual  attacker  (defender) . 

Define  the  following  functions: 

•  b(t),  an  approximate  representation  of  the  number  of 
attackers  alive  at  time  t,  given  the  number  of 
attackers  and  defenders  entering  combat  initially. 

•  d(t),  an  approximate  representation  of  the  number  of 
defenders  alive  at  time  t,  given  the  number  of 
attackers  and  defenders  entering  combat  initially. 

B.  DETERMINISTIC  MODEL:  LLL  MODEL 

Assume  that  the  attrition  rates  are  proportional  to  the 
number  of  targets  as  well  as  the  number  of  firers.  The 
combat  process  can  be  modelled  deterministically  (LLL;  see 
Taylor  (1983))  by  the  following  system  of  differential 
equations : 


db(t) 

dt 


dd  ( t ) 
dt 


aD  b  (t)  d  (t) 


aB  b(t)  d  (t ) 
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(B.l) 


with  initial  conditions: 


b (0)  =  B ( 0 ) 

d (0)  =  D ( 0 ) 

The  first  equation  of  (B.l)  represents  the  rate  of  change 
of  b(t)  as  a  function  of  time.  The  expression  states  that 
the  rate  of  change  of  the  attackers  depends  on  the  number 
of  attackers  and  defenders  alive  at  time  t.  The  expected 
decrease  in  b(t)  caused  by  a  defender  killing  an  attacker  is 
represented  by  the  term  aDb(t)d(t).  A  similar  argument  is  used 
to  write  the  second  expression  of  (B.l). 

Before  presenting  the  solution  for  (B.l),  we  carry  out 
a  similar  analysis  as  for  the  BCD  scenario  presented  in  Chap¬ 
ter  IV.  From  (B.l),  we  get: 


db(t)  _ 


dd  (t ) 
dt 


(B .  2 ) 


Integrating  both  sides  of  (B.2),  we  obtain: 


Criteria  for  Defenders  to  Win 

A  rough  criterion  for  defenders  to  win  can  now  be  obtained 
by  assuming  that  in  order  to  conclude  that  defenders  won, 
we  must  have  b(°°)  =  0  and  d(°°)  >  0.  Under  this  assumption, 
and  as  t  -*■  «°,  (B.3)  becomes: 

aDd(°°)  =  aDD(0)  -  aBB(0)  (B.4) 

Since  ag,  ag,  and  d(°°)  are  all  positive  values,  then: 

aDD(0)  -  agB  ( 0 )  >  0 

Therefore,  the  condition  for  the  defenders  to  win  is  to 
satisfy  the  following  condition: 

aDD(0)  >  aBB(0)  (B.5) 

Notice  that  equation  (B.5)  is  the  same  as  equation  (4.9) 
which  gives  the  condition  for  the  defenders  to  win  in  air- 
to-air  combat  under  the  BCD  scenario.  So  the  deterministic 
model  for  the  LLL  model,  which  is  usually  used  to  represent 
land  combat,  and  the  BCD  model  resulted  in  the  same  condition 
for  the  defenders  to  win  (eventually) .  This  is  due  to  the 
fact  that  the  condition  given  by  equation  (4.9)  (hence,  (B.5)) 
is  independent  of  the  engagement  rate  6,  and  also  because  of 
the  fact  that  the  product,  b(t)d(t),  in  (4.1)  and  (B.l)  can 
be  replaced  by  any  function  with  the  same  result. 


The  solution  for  equation  (B.l)  is  given  by  Taylor  (1983): 


aBB  -aDD 


b(t)  = 


|  aigB  -aDD  exp  [-  (agB  -o^D)  t] 

1 


B 

1  +OgBt 


]  for  aDD  /  aBB 


for  ctpD  =  OgB 


( B .  6 ) 


and 


d(t)  = 


cup-c^B 

j  °(0)  [o^D  -ctgB  exp  [-(c^D  -cigBJt]1  for  “d0  *  aBB 


1  +a_Dt 


for  aDD  =  c^B 


These  equations  permit  easy  numerical  computation  of  b(t), 
and  d(t),  i.e.,  the  representations  for  the  number  of  combatants 
of  both  forces  at  various  points  in  time  during  the  combat 
period . 

C.  DIFFUSION  MODEL  FOR  THE  LLL  SCENARIO 

Following  the  arguments  used  in  Chapter  IV  to  derive 
the  diffusion  approximation  for  the  BCD  scenario,  we  can 
formulate  the  combat  process  under  the  LLL  scenario  as  a 
diffusion  process. 

Define  the  following: 

•  B ( t )  to  be  a  stochastic  diffusion  representation  for 
the  number  of  attackers  alive  at  time  t. 

D ( t )  to  be  a  diffusion  representation  for  the  number 
of  defenders  alive  at  time  t. 


m 


•4i»» 

a 

m 

■o 
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•  N  to  be  the  total  number  of  combatants  of  both  forces 

available  for  combat  initially  (i.e.,  N  =  B(0)  +  D(0)) 

We  can  characterize  the  land  combat  process  approximately 
when  N  -*  °°  (hence,  B(0)  +  D(0)  -*•  °°)  ,  by  treating  (B(t),D(t); 
t  ^  0}  as  a  bivariate  diffusion  process.  We  can  model  the 
state  vector  (B(t),D(t);  t  >_  0 }  by  writing  it  in  the  form 
of  Ito  stochastic  differential  equations  as  follows: 


dB  ( t )  =  -a  B(t)D(t)dt  -  /aDB(t)D(t)  dW(t) 


dD  ( t)  =  -aBB(t)D(t)dt  +  /aBB(t)D(t)  dW(t) 


(B.  7 ) 


:?$ 

% 


where  (W(t);  t  >_  0}  is  a  standard  Wiener  process, 
Consider  the  following  transformation: 


*i*S 

•$! 


i 


B  (t )  =  Nb (t )  +  /N  X1(t) 


D  ( t )  =  Nd  ( t )  +  /N  X2  (t) 


Differentiating  (B.8),  we  obtain: 


(B .  8 ) 


dB (t )  =  N  db ( t )  +  /N  dX2 (t) 


dD ( t )  =  N  dd  (t)  +  /N  dX2 (t) 


( B .  9  ) 


where:  b(t)  and  d(t)  are  deterministic  functions  of  time, 


being  approximations  to  the  process  means  (X^(t);  t  ^  0}, 


i  =  1,2,  are  stochastic  elements,  all  of  which  need  to  be 
determined . 


Suppose  that  X^(0)  =  X2(0)  =  0.  Then  we  obtain. 


b  ( 0 ) 


B  ( 0 ) 
N 


(B.10) 


and 


d  (0) 


D(0) 

N 


Let  otg  =  otgN  and  =  aDN  to  be  constants  as  N  -*•  <*>;  i.e., 
assume  that  ag  and  to  be  small  enough  such  that  afiN  and 
aQN  ->  constant  as  N  +  This  means  that  on  the  average  a 

defender  or  an  attacker  takes  a  relatively  long  time  to 
achieve  a  kill. 

Now,  substituting  (B.8)  and  (B.9)  into  (B.7),  and  isolat¬ 
ing  terms  of  order  N  and  /N,  and  letting  N  -*■«>,  we  obtain 
the  following  sets  of  equations. 

1 .  Deterministic  Equations 

The  terms  of  order  N  yield: 


db(t) 

dt 


aDb (t) d  (t) 


dd  (t) 
dt 


oigb  ( t )  d  (t ) 


(B.ll) 


with  initial  conditions  given  by  (B.10). 
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Equations  (B.ll)  are  equivalent  to  equation  (B.l), 


which  shows  that  the  diffusion  approximation  for  the  LLL 
scenario  results  in  the  same  approximations  for  the  process 
means  as  the  deterministic  model. 

2 .  Stochastic  Equations 

The  terms  of  order  /N  yield: 

dX^(t)  =  -{aDd(t)X1(t)  +  aDb(t)X2(t)  dt  -  */aD5(t)d(t)  dW(t) 

(B.12) 

d}^  (t)  =  -{ogdCtJX-^  (t)  +  OgbCt^Ct)  dt  +  ^TtJHTET  dW(t) 

Writing  the  above  in  a  matrix  form,  we  get: 

dX ( t )  =  A ( t ) X {t ) dt  +  V ( t ) dW ( t ) 


where : 


X(t)  = 


x1(t) 


L  x2(t) 


and 


V(t)  = 


-/fiDb(t)d(t) 


/dgb  (t)  d  (t) 
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4  v 


■y-'yy'Vv 


<1 


A  (t )  = 


a^d(t)  -ctpb(t) 


aBd(t)  -aBb(t) 


Since  X(0)  =  15,  b(0)  and  d(0)  are  given  by  (B.lOi 


Then  by  appealing  to  the  central  limit  theorem,  for  all  t  >  0, 


{X^  (t)  ,X- (t)  ;  t  >_  0}  has  a  bivariate  normal  distribution 
with  mean  3  and  covariance  matrix  £ (t)  which  satisfies  the 


following  differential  equation  (Arnold,  1974): 


3t  E<t) 


A  (t)  Z  ( t )  +  I(t)AT(t)  +  V(t)VT(t) 


(B . 1 3 ) 


Recall  that 


B  ( t ) 


D(t) 


=  N 


b  (t ) 


d  (t) 


xx  (t) 


+  /N 


X2(t) 


Therefore,  we  have  obtained  the  following: 


RESULT  (B. 1) : 


{ B ( t ) , D ( t ) }  is  approximately  bivariate  normal 


(Gaussian),  as  N  (hence,  B(0)  and  D(0)  °°  simultaneously 


and  in  a  fixed  proportion) . 


{ B (t ) , D ( t ) }  =  Normal (N (b (t) ,d (t) ) ,N1 (t) ) 


By  the  required  substitution  and  multiplication 


get : 


-*  ->T 

V(t) V  (t) 


otDb(t)d  (t) 


-b(t)d(t) 


-b(t)d(t)/a^  afib(t)d(t) 


Writing : 


I  (t) 


On  (t)  a12  ^ 

a12(t)  a22(t) 


Equation  (B.13)  becomes: 


d_ 

dt 


S(t) 


G(t)S(t)  +  H  (t ) 


with  initial  conditions: 


s<3)  =  3 


where : 


it 


| 


9 


n 


$ 


id 


XI 

vl 

w 


-2aDd(t)  -2aDb(t)  0 

G(t)  =  -a_d(t)  -  ('  ,b  (t )  +and  ( t )  -anb(t) 


-2aBd(t) 


-2aBb (t) 


aDb (t)d  (t) 


H  ( t )  =  -b(t)d(t)/aBaD 

agb  (t)  d  (t) 


D.  LLL  MARKOVIAN  COMBAT  MODEL 

Suppose  an  attacker  takes  an  exponential  amount  of  time 
with  mean  or1  to  kill  a  defender;  and  that  a  defender  takes 
an  exponential  amount  of  time  with  mean  a”1  to  kill  an  attacker, 
Then  the  combat  process  can  be  represented  by  the  bivariate- 
continuous-time  discrete-state  Markov  process  {B(t),D(t); 
t  _>  0}  operating  on  the  state  space  S  =  {(i,j):  0  <  i+j ; 
i  =  0,1,. . . , B ;  j  =  0,1, . . . , D } . 

The  transition  probabilities  of  the  process  {B(t),D(t); 
t  >  0}  of  order  dt  are  as  follows: 


t+dt 


( i  »  j  ) 


( i ,  j  - 1 ; 
(i-1,  j) 
(i,  j  ) 


Probabil it\ 


fB  (i , j )dt  +  o (dt) 
f D  ( i  ,  j  )  dt  +  o  (dt ) 

1  -  f  ( i  ,  j  )  dt  +  o  (dt ) 


(B . 14 ) 


TO 


where : 


fB(i,j)  =  aBij 
fD(i,j)  =  aDij 
f (i  /  j  )  =  fg (i ,  j  )  +  f D ( i , j  ) 

Let 

Pmn,ij(t)  =  p{B(t)  =  =  j  1 B  (0 )  =  m,D(0)  =  n} 

For  simplicity  of  notation  we  will  suppress  the  initial 
condition,  and  write: 


mn  / 1  ^ 


Apparently  (B(t),D(t);  t  0}  as  defined  by  (B.14)  is 
a  finite  state  bivariate  death  process. 

The  forward  Chapman-Kolmogorov  equations  are: 


PB,j<W  -  +  fB(b.j+l)PB>j+1(tl  liiiD-1 

Pi,D(t)  =  •f(i’D)Pi,D(t)  +  fD(i+1,D)Pi+l,D(t)  1  i  i  i  B-l  (B.15) 
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* 
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i 
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i 
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I 
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i; 
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•Si 

a 

('I 

>i 

'Ml 


a 


* 


pi,j(t>  -  -*(i.j)pifj<t) +fB(i.j+DPiij+ii 


+  fD(i+l,j)Pi+1^j (t)  1  <_  i  £  B-l 

1  1  j  1  D_1 


(B .  1 5 ) 
(Cont ’d) 


P0,jlt)  '  fD(1'J)Pl.j(t> 


with  initial  condition; 


1  <  j  <  D 


1  <  i  <  B 


pi,i(0> 


if  (i,j)  =  (B , D) 


otherwise 


Let  P.  .  (s)  be  the  Laplace  transform  for  P.  .  (t) .  Then; 
1 / J  i/J 


P.  .  (s)  =  /  e  s  P.  .(t)dt  s  >  0 

i/l  0  1 ' l 


We  now  take  the  Laplace  transforms  for  (B.15)  by  follow¬ 
ing  the  procedure  done  for  the  BCD  scenario;  and  using  the 
initial  condition  we  get: 


m mmmm 


PB,D(S) 


Pi,j<Sl 


Po,j<s) 


Pi,0<s> 


f (B,D)+s 


PB,j(S>  '  f  (B,j)+s[fB®,:i+1)PB,j+l(s) 


}  1  <  j  <  D-l 


Pi,DlS» 


f (i,D)+s‘£D<1+1,D)Pi+l,Dls> J 


1  <  i  <  B-l 


f (i,j)+s*fB(l/^+1)Pi,j+l(s)  +  fD(l+1,^)Pi+l,j  (s)} 

1  i  j  1  B-l 
1  <  j  <  D-l 


(B . 16 ) 


S  fD(l'^Pl  ,  j  (s) 


1  <  j  <  D 


1  <  i  <  B 


Figure  (B.l)  shows  a  graph  representation  for  the  Markovian 
combat  process.  Equations  (B.16)  are  in  a  form  that  is 
suitable  for  a  recursive  solution. 

PD  n(s)  is  given  in  (B.16).  Now  we  can  find  PD  ^  .(s) 

B  /  U  D  t  L*  -L 

A  a 

and  Q(s)  since  they  are  functions  of  PB  Q(s)  only.  The 

A  A 

PB  D-l  ^ s  ^  an<^  PB-1  d  ^ s  ^  are  tbe  only  transforms  needed  to 

A  A  A 

find  pB/D_2^s)'  Pb-1,D-1^S^'  and  PB-2  D^S^'  aS  9iven  bV  (B.16). 
Continuing  this  way,  we  find,  as  in  the  BCD  Markovian  model, 

that  by  knowing  the  Laplace  transforms  of  the  states  in  the 
nfc^  depth  of  the  graph,  the  Laplace  transforms  for  the  (n+l)st 
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depth  1 


IW»  IWHFJ  l*1  IP  i  IW 1H 


^WWTtfTUirwmfun1 


depth  can  be  calculated  for  any  value  of  s.  Therefore,  an 
algorithm  similar  to  the  algorithm  used  to  solve  (4.49)  can 
now  be  constructed  to  solve  (B.16): 

1.  Construct  the  graph  of  the  process  as  follows: 

For  the  nth  depth,  find  the  possible  states  and 
calculate  its  width,  i.e.,  how  many  states  are  in 
the  n*-*1  depth.  Continue  until  the  width  of  the 
depth  is  zero. 

i.  i_ 

2.  For  the  n  depth,  if  the  width  =  0,  stop.  Else, 
pick  a  state  (say  (i,j)).  Then: 

a.  Calculate  the  mean  of  the  corresponding  sojourn 

time  of  the  state  (i.e.,  (f(i,j))~l). 

s  t 

b.  Examine  all  states  in  the  (n-1)  depth  to  deter¬ 
mine  states  that  are  accessible  to  state  (i,j). 

c.  Calculate  the  corresponding  transition  rates  from 
the  states  determined  in  b .  to  state  (i,j). 

d.  Calculate  the  Laplace  transform  for  (i,j).  Repeat 
for  all  states  in  the  nfch  depth. 

The  solutions  for  (B.16),  i.e.,  the  Laplace  transforms, 

can  be  used  to  evaluate  quantities  of  interest,  such  as: 


TrD(i)  =  P{i  defenders  eventually  survive  combat} 


Following  the  same  arguments  presented  for  the  BCD  model, 
it  can  be  shown  that: 


ttdU)  =  fDd,j)P1#j  (0)  (B.17) 

and 

D 

E[B(»)  |B(0)  =  B,D(0)  =  D]  =  £  jfn(l, j)P,  .  (0)  (B.18) 

j=l  ° 
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E.  SIMULATION  OF  LLL  MARKOVIAN  SCENARIO 

Following  the  same  arguments  used  for  simulating  the 
BCD  scenario,  we  can  simulate  the  LLL  Markovian  combat 
process . 

The  Monte-Carlo  simulation  was  constructed  based  on  the 
following : 

a.  The  time  spent  by  the  process  at  state  (i,j)  is 
exponentially  distributed  with  rate  f(i,j). 

b.  The  transition  probabilities  for  the  embedded 
Markov  chain,  are  as  follows: 


Present 


Next 


Probability 


( i »  j  )  (i  ,  j  -1 ) 


( i-1 ,  j  ) 


fB(i'j) 
f  (i/  j ) 

fD(i'j) 

f  ( i  ,  j  ) 


(B . 19 ) 


Generate  and  U 2  as  in  the  BCD  simulation.  A  realiza¬ 
tion  of  X.  .,  time  spent  in  state  (i,j)  can  be  obtained  by: 

1,3 


X.  . 


-  In 

f  ( i  ,  j  f 


(B . 20 ) 


After  spending  X.  .  units  of  time  in  state  (i,j),  the 

1 1  3 

process  will  transit  to: 


( i , j -1 )  if 


(i-1,  j) 


fR(i,  j) 

0  <  U.,  <  - ry— 

2  -  f (l , j  ) 


otherwise 


(B . 21 ) 
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Let  {Bm  (nAt)  ,Dm  (nAt)  ;  M  =  1,2,..., M}  be  a  (the  mt^1) 
realization  of  the  process  (B(t),D(t)}  at  time  nAt,  and 

fcll 

during  the  nr  replication  of  the  simulation  model. 

Defining  BB,  BS,  DD,  and  DS  as  in  the  BCD  simulation, 
we  can  calculate  the  statistics  by  applying  equations 
(4.85)  and  (4.86). 

The  following  basic  data  were  used  as  an  example  for 
model  illustration. 

A  threat  of  B ( 0 )  =  12  attackers  engaging  exactly  D(0) 
defenders.  Each  defender  and  attacker  is  assumed  to  take 
an  exponential  amount  of  time  with  mean  (aD)  1  =  (.008)  1 
minutes,  and  (aD)  1  =  (.004)  ^  minutes  respectively,  to  kill 
an  opponent . 

Suppose  we  are  interested  in  evaluating  P{B(t)  >  3[ 

B ( 0 )  =  12 ,D (0)  =  j}  for  j  =  1,2,..., 20.  FORTRAN  programs 
were  written  for: 

1.  Computing  the  stochastic  mean,  variance  and  proba¬ 
bility  distribution  for  B(t)  using  the  forward 
Chapman - Ko lmogo  ro v  equa  t i o  n  s . 

2.  Computing  the  approximate  mean  and  variance  using 
the  diffusion  approximation  to  compute  the  required 
probability. 

3.  Simulating  the  Markov  process  to  compute  the  stochas¬ 
tic  mean,  variance,  and  required  probabilities. 

For  illustration  purposes  the  following  values  for  D(0) 
were  considered: 

D  (0 )  =  3,  5,  10,  12,  16  and  20 
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Figure  (B.2)  shows  a  plot  of  the  stochastic  mean  result¬ 


ing  from  the  simulation  model  and  the  deterministic  mean 
resulting  from  the  diffusion  model.  It  is  clear  from  the 
plot  that  there  exists  a  bias  between  the  stochastic  mean 
and  the  deterministic  mean.  The  bias  +  0  as  D(0)  increases. 

It  is  also  clear  that  the  deterministic  mean  underestimates 
the  stochastic  mean. 

Figure  (B.3)  shows  a  plot  for  the  variance  function  result¬ 
ing  from  simulation  compared  to  the  variance  function  result¬ 
ing  from  diffusion  approximation,  for  the  various  values  of 
D  ( 0 )  .  VJe  find  that  the  variance  of  the  diffusion  tends  to 
approach  that  provided  by  simulation  as  D(0)  increases. 

Figures  (B.2)  and  (B.3)  show  that  the  diffusion  approximation 
model  results  in  good  approximation  as  D(0)  increases.  The 
example  shows  that  for  a  relatively  small  value  of  D(0), 
e.g.,  D ( 0 )  =  16  and  D(0)  =  20,  the  diffusion  approximation 
started  to  result  in  a  good  approximation. 

Since  there  exists  bias  in  both  of  the  mean  and  variance 
approximations,  we  therefore  expect  to  have  some  difference 
between  the  actual  probabilities  for  the  Markov  process  and 
the  probabilities  resulting  from  applying  the  normal  approxi¬ 
mation.  To  compare  the  different  values  for  P{B(t)  >  3| 

B ( 0 ) , D ( 0 ) }  a  value  of  t  =  20  minues  was  selected. 

Figure  (B.4)  shows  a  comparison  of  the  actual  values  for 
P { B ( t )  >  3 | B  (0 ) , D  (0 ) } ,  as  a  result  of  solving  the  forward 
Chapman-Kolmogorov  equations  numerically,  to  the  normal 
approximation  values  with  continuity  correction  using  the 
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Plots  of  the  Variance  Approximation  Resulting 
from  Diffusion  Versus  Variance  from  Simulation 
of  B(t):  LLL  Scenario 


ACTUAL 


igure  B.4.  Comparison  of  Actual  Value,  to  Normal  Approximation 
with  Continuity  Correction  and  to  the  Simulation 
Results,  of  P{B(20)  >  3|B(0)  =  12,D(0)  =  j}  for 


diffusion  approximation,  and  the  probability  resulting  from 
the  simulation  model.  We  find  that  the  simulation  output 
represents  the  actual  probability  obtained  by  solving  the 
Chapman-Kolmogorov  equations.  The  diffusion  tends  to  give 
a  better  approximation  as  D(0)  -*■  <=°. 

Figure  (4.5)  shows  plots  for  the  various  differences 
between  the  probabilities  which  supports  the  above  observation. 


SIMULATION  -  NORMAL  APPROX. 


Differences  of  the  Various  Values  of  the 
Probabilities  Shown  in  Figure  4.9 
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